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Preface 


This  report  outlines  the  research  undertaken  by  Honeywell,  Inc.,  Sensor  and  Guidance  Products, 
Minneapolis,  MN  and  Samoff  Corp.,  Princeton,  NJ,  under  U.S.  Army  Contract  DAAN02-98-C- 
4034,  for  the  period  Jime  1998  to  December  2000. 

This  report  describes  the  design  of  a  combat  vehicle  visualization  system  that  provides  increased 
situation  awareness  to  the  vehicle  commander  while  seated  inside  the  vehicle  or  while  standing 
in  an  open  hatch.  The  system  gives  the  vehicle  commander  the  ability  to: 

1)  detect  terrain  hazards  in  the  vehicle’s  path  to  aid  the  driver  in  recognizing  hazardous 
situations  that  might  immobilize  the  vehicle  or  cause  damage  to  the  vehicle  and  its 
crew, 

2)  detect  nearby  friendly  forces  and  environmental  structures  to  coordinate  movement 
with  other  vehicles  and  to  avoid  damage  to  the  vehicle,  nearby  friendly  forces,  or  man 
made  structures, 

3)  detect  nearby  ground  threats  to  allow  protective  responses  to  be  employed, 

4)  view  imagery  from  the  commander’s  independent  viewer  while  standing  in  the  open 
hatch, 

5)  view  information  on  the  commander’s  tactical  display  while  standing  in  an  open 
hatch  to  allow  immediate  notification  of  incoming  reports  and  to  assist  in  the 
preparation  of  outgoing  reports  without  the  need  to  duck  back  into  the  vehicle, 

6)  view  Unmanned  Aerial  Vehicle  (UAV)  reconnaissance  imagery  while  seated  inside 
the  vehicle  or  while  standing  in  an  open  hatch. 

The  system  can  also  be  used  by  a  squad  leader  in  the  vehicle’s  passenger  compartment  as  a 
reconnoitering  aid  prior  to  exiting  the  vehicle  for  dismoimted  operations.  These  capabilities  are 
especially  useful  at  night  when  the  enemy  is  in  the  vicinity  and  when  direct  vision  is  impaired 
because  vehicle  hatches  must  be  buttoned  up  and  vision  blocks  must  be  covered  to  avoid 
detection. 

The  report  describes  a  prototype  system  that  demonstrates  essential  system  features  using 
existing  components  to  reduce  development  cost.  Improvements  envisioned  for  a  deployable 
system  are  discussed.  Finally,  vehicle  insertion  opportvmities  are  identified. 
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IX 


SEE-THROUGH  TURRET  VISUALIZATION 

PROGRAM 

1.0  Introduction 


The  See-Through  Turret  Visualization  (STTV)  program  is  a  Defense  Advanced  Research 
Projects  Agency  (DARPA)  -funded  research  effort  contracted  through  the  U.  S.  Army  Soldier 
Systems  Center  at  Natick,  Massachussetts.  It  was  proposed  in  response  to  DARPA  BAA  96-37, 
Warfighter  Visualization,  dated  15  November  96.  A  major  goal  of  this  Broad  Agency 
Announcement  (BAA)  was  “to  enhance  individual  warfighter  situation  awareness  and  decision 
making  ability  by  providing  unique  ways  of  receiving  and  interacting  with  spatially  correct, 
timely  information  in  both  individually  served  and  shared  environments."  Areas  of  interest 
identified  in  the  BAA  were:  “I.  Visually  Coupled  Systems,  ...e.g.,  head-mounted  displays  and 
displays  that  allow  users  to  see  through  physical- barriers  such  as  the  hull  of  tanks...,  and  IB. 
Enhanced  Human  Interface  Technologies,  ...e.g.,  high  resolution  wide  field-of-view  systems, 
and  systems  for  the  collection,  fusion,  and  display  of  data  containing  large  dynamic  ranges  in 
luminance  and  contrast...."  It  was  further  specified  that  “All  contractors  are  encouraged  to  have 
direct  interaction  with  operational  forces  during  the  design  and  development  process.  All 
systems  should  be  demonstrated  in  at  least  one  end  product  that  functions  in  an  operational 
environment.  These  products  will  be  integrated  into  Warfighter  Visualization  demonstrations 
which  will  be  conducted  with  a  military  customer.  Selected  applications  are  expected  to  include: 
...tank/armored  vehicle... and  a  dismounted  warrior...  Approaches  that  provide  demonstration 
plans  are  strongly  encouraged.” 

The  objective  of  the  See-Through  Turret  Visualization  program  is  to  enhance  the  situation 
awareness  of  armored  vehicle  commanders  by  providing  a  visualization  system  consisting  of  a 
360°  field-of-view  panoramic  image  sensor,  an  image  processor,  and  a  helmet-mounted  display 
with  head  tracker.  The  visualization  system  allows  commanders  to  view  the  situation  awareness 
data  from  a  Force  XXI  Battle  Command  Brigade  and  Below  (FBCB2)  terminal  while  standing  in 
the  hatch,  a  vantage  point  which  is  used  by  most  commanders  when  not  engaging  the  enemy,  but 
one  which  obscures  the  view  of  the  FBCB2  display  inside  the  vehicle.  When  engaging  the 
enemy,  the  panoramic  sensor  allows  commanders  effectively  to  see  through  the  vehicle’s  hull 
and  to  view  the  surrounding  terrain  on  the  helmet-mounted  display.  Panning  around  the  vehicle 
is  achieved  naturally  via  the  head-tracked  sensor,  leaving  hands  free  for  other  duties.  The  image 
processor  removes  the  image  warping  generated  by  the  wide  field-of-view  camera  lenses,  merges 
the  outputs  of  multiple  cameras  into  a  single  seamless  wide  field-of-view  image,  and  fuses  the 
imagery  from  two  different  sensors  to  provide  the  commander  an  enhanced  awareness  of  the 
vehicle’s  surroundings.  The  commander’s  helmet-mounted  display  was  chosen  to  be  identical  to 
the  dismounted  soldier’s  helmet-mounted  display  being  developed  under  the  Army’s  Land 
Warrior  program  to  achieve  reduced  system,  logistics,  and  maintenance  costs. 

The  See-Through  Turret  Visualization  program  capitalized  on  a  long  history  of  Honeywell 
efforts  to  provide  a  helmet-mounted  display  for  armored  vehicles.  In  October  1985,  Honeywell 
and  the  U.  S.  Army  evaluated  a  monocular  see-through  Integrated  Helmet  And  Digital  Display 
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System  (IHADSS)  type  helmet-mounted  display  on  an  MlAl  tank  at  Fort  Knox  {Figure  1).  The 
display  viewed  live  Commander’s  Independent  Thermal  Viewer  (CITV)  imagery  and  situation 
awareness  data  from  a  Battle  Management  System  developed  by  Lockheed.  Excellent  results 
were  obtained,  and  participating  tank  commanders  liked  the  system.  Tlie  display  was  later 
exhibited  on  an  MIA!  tank  at  the  Fort  Knox  Armor  conference  along  with  a  mockup  of  a 
productized  version.  In  August  1992,  Honeywell  began  the  development  of  a  new  helmet- 
mounted  display  for  armored  vehicles  under  a  DARPA-funded  contract  administered  by  the  U. 
S.  Army  Soldier  Systems  Center  at  Natick,  Massachusetts  (contract  DAAK60-92-C-0065,  titled 
Combat  Vehicle  Crew  (CVC)  Helmet-Mounted  Display).  The  display  w'as  a  biocular  see- 
through  640  X  480  pixel  head-mounted  display  built  into  the  tank  commander’s  goggles  (Figure 
2).  The  display  was  subsequently  evaluated  by  the  Army’s  Mounted  Warfare  Battle  Lab  in  the 
Distributed  Interactive  Simulation  Facility  at  Fort  Knox  under  an  Army-funded  contract 
administered  by  the  U.  S.  Army  Soldier  Systems  Center  (contract  DAAK60-94-C-2021,  titled 
Enhanced  User  Evaluation  and  Demonstration  of  the  CVC  HMD).  Two  evaluations  were 
performed  in  June  1994  and  February  1995  using  simulated  CITV  and  Inter  Vehicular 
Information  Sy.stem  (IVIS)  display  screens  developed  with  the  assistance  of  General  Dynamics 
Land  Systems.  The  screens  were  displayed  to  Army  user  juries  via  the  Simulation  Network 
(SIMNET)  and  the  CVC  display.  A  hand  controller  w'as  also  used  but  no  head  tracker.  It  was 
concluded  that  the  helmet-mounted  display  improved  the  commander’s  performance  in  real 
battle  scenarios  with  no  task  or  infoimation  overload.  Tank  commanders  on  the  user  jury 
volunteered  that  “we  need  this  HMD.”  In  July  1995  and  again  in  August  1996,  evaluations  of 
the  CVC  HMD  with  vehicle  motion  were  performed  using  the  Crewman’s  Associate  Ride 
Motion  Simulator  at  the  Tank  Automotive  Research  Development  and  Engineering  Center 
(TARDEC).  The  conclusion  wris  that  the  helmet-mounted  display  performed  w'ell  on  a  moving 
vehicle  as  long  as  it  was  sufficiently  stabilized  relative  to  the  head.  The  groundwork  was  thus 
prepared  for  testing  a  helmet-mounted  di.splay  on  a  moving  Ml  A2  tank. 


Figure  1 .  Honeywell  CVC  helmet- 
mounted  display  evaluated  in  1985 


Figure  2.  Honeywell  CVC  helmet- 
mounted  display  evaluated  in  1994-95 


The  See-Through  Turret  Visualization  program  was  awarded  to  Honeywell  on  18  June  1998.  It 
was  conceived  as  an  evaluation  of  a  helmet-mounted  display  on  a  moving  M1A2  tank.  The 
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program  was  planned  as  a  four-phase  effort.  Phase  I  addressed  concept  development,  Phase  II 
preliminary  system  design.  Phase  III  detailed  system  design,  and  Phase  IV  system  integration 
and  demonstration.  Phase  I  included  the  development  of  a  System  Requirements  Specification 
and  a  Prototype  Development  Specification  for  a  prototype  visualization  system.  Phases  n  and 
III  addressed  the  design  of  the  prototype  system,  and  Phase  IV  addressed  the  fabrication  of  the 
hardware  and  software,  its  integration  into  an  M1A2  tank  or  other  sumogate  vehicle,  and  its 
evaluation  on  the  moving  vehicle.  In  early  1999  it  became  apparent  that  DARPA  w'ould  be  able 
to  provide  only  about  half  of  the  funding  required  to  complete  the  foil  program.  Therefore,  it 
was  agreed  to  eliminate  the  vehicle  integration  and  moving  vehicle  evaluation  tasks  in  Phase  IV, 
and  to  address  only  the  laboratory  evaluation  and  demonstration  of  the  prototype  system.  The 
following  sections  describe  the  w'ork  performed  on  these  tasks  and  the  results  achieved. 


Section  2.0  describes  the  methods,  assumptions,  and  procedures  used  in  the  program.  Section 
3.0  summarizes  the  results  obtained.  These  include  the  results  of  a  user  needs  survey  (Section 
3.1),  a  system  requirements  specification  (Section  3.2),  trade  studies  to  define  a  prototype 
development  system  (Section  3.3),  a  prototype  development  specification  (Section  3.4),  a 
description  of  the  prototype  system  developed  (Section  3.5),  and  system  demonstrations 
performed  (Section  3.6).  Section  4.0  describes  the  conclusions  obtained.  One  conclusion  is  that 
the  prototype  system  is  representative  of  a  final  deployable  system  and  is  sufficiently  robust  to 
support  further  evaluation  of  its  effectiveness  on  a  moving  armored  vehicle.  A  second 
conclusion  is  that  the  display  alone,  without  a  sensor,  processor,  or  head  tracker,  can  improve  the 
performance  of  the  armored  vehicle  commander.  Section  5.0  describes  some  recommendations 
for  further  work,  which  include  testing  of  the  prototype  system  on  a  moving  armored  vehicle  and 
development  of  a  fully  deployable  .sensor,  helmet-mounted  display,  and  head  tracker. 
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2.0  Methods,  Assumptions,  and  Procedures 

The  following  methodology  was  used  to  develop  the  See-Through  Turret  Visualization  System 
described  in  this  report.  First,  a  survey  of  user  needs  was  performed  to  understand  the  system 
requirements.  Interviews  were  conducted  with  U.  S.  Army  tank  commanders  at  the  U.  S.  Army 
Armor  Center  at  Fort  Knox.  Physical  inspections  of  armored  vehicles  were  performed  at  several 
sites,  and  an  extensive  review  of  the  existing  literature  was  made.  Next,  a  System  Requirements 
Specification  was  written  to  document  the  needs  of  an  armored  vehicle  commander  for  situation 
awareness  information.  Trade  studies  were  then  perfoimed  to  define  a  visualization  system  that 
uould  satisfy  the  system  requirements.  Trade  studies  addressed  sensor  performance,  helmet- 
mounted  display  capabilities,  head  tracker  availability,  demonstration  vehicle  selection,  and 
vehicle  interfaces.  Next,  a  hypothetical  deployable  visualization  system  was  conceived  that  was 
capable  of  meeting  the  specified  requirements.  This  visualization  system  involved  sensors, 
processors,  helmet-mounted  displays  and  head  trackers  whose  performance  exceeded  what  was 
available  during  the  time  frame  of  the  program.  Next,  a  prototype  of  the  hypothetical  system 
ua^  defned  that  could  demonstrate  the  essential  system  operation  in  a  timely  fashion  using 
existing  components  to  minimize  program  cost,  although  at  the  expense  of  ultimate  performance. 
•\  Prototvpe  Development  Specification  was  then  created  to  describe  the  prototype 
dem.ir.stration  system.  Next,  the  prototype  system  was  designed  and  fabricated.  Finally,  the 
rrcv.,):ype  system  was  evaluated  in  the  laboratory  and  on  a  stationary  HMWWV  vehicle.  User 
dem.e'.strations  were  also  earned  out  at  the  Fort  Knox  Armor  Conference  and  the  Association  of 
ti'c  I  'n-ited  States  Amn  (AUSA)  show  in  Washington,  D.  C. 

1;  .-..i'  been  assumed  tliat  the  See-Through  Turret  Visualization  program  addresses  the  situation 
.luarencss  needs  cif  the  armored  vehicle  commander  only,  and  not  the  needs  of  the  driver, 
gunner,  uiader.  or  passengers.  However,  it  does  address  the  situation  awareness  needs  of  a  squad 
leader  :r.  an  armored  personnel  carrier,  such  as  an  M2A3  Bradley,  where  the  squad  leader  needs 
nruei.  o;  tiie  same  situation  awareness  information  as  the  vehicle  commander  before  dismounting 
irorr.  tire  v  eiiicle  on  a  mission.  This  includes  mission  data  from  the  FBCB2  system  and  a  view  of 
tile  terrain  surrounding  the  vehicle  to  locate  immediate  threats  for  avoidance  or  neutralization. 


4 


3.0  Results  and  Discussion 


3.1  User  Needs  Survev 

A  survey  of  user  needs  was  performed  to  understand  armored  vehicles  and  the  requirements  of 
vehicle  commanders  for  situation  awareness  information.  The  survey  included  detailed 
interviews  with  U.  S.  Army  tank  commanders  at  the  Fort  Knox  Armor  School,  physical 
inspections  of  armored  vehicles  at  several  sites,  and  an  extensive  review  of  the  existing  literature. 

Interviews  were  conducted  with  U.  S.  Army  tank  commanders  during  visits  to  the  U.  S.  Army 
Armor  Center  at  Fort  Knox  on  26,  27  August  1998  and  9  September  1998.  The  half-day 
interviews  involved  two  MlAl  and  M1A2  tank  commanders  who  were  also  instructors  of  tank 
commanders  at  the  U.  S.  Army  Armor  School  The  information  they  provided  correlated  well 
with  interviews  held  with  five  U.  S.  Army  MlAl  commanders  who  served  as  jurists  during  a 
previous  Army  contract  (contract  DAAK60-94-C-2021,  titled  Enhanced  User  Evaluation  and 
Demon.stration  of  the  CVC  HMD).  It  also  correlated  well  with  interviews  held  with  two  U.  S. 
Army  MlAl  commanders  w'ho  evaluated  Honeywell’s  first  CVC  helmet-mounted  di.splay  on  8 
and  9  October  1985. 

Interviews  were  conducted  with  U.  S.  Army  Bradley  commanders  during  a  Bradley  Fire  Support 
Team  (BFIST)  vehicle  demon.stration  of  the  Land  Warrior  display  at  Fort  Sill  on  16  June  1997. 
Additional  interviews  were  conducted  during  user  tests  of  a  helmet-mounted  display  on  a 
Bradley  M2.A3  sponsored  by  the  Bradley  program  office.  The.se  tests  consisted  of  an 
organizational  meeting  on  23  September  1998.  and  a  Limited  User  Te.st  at  Yuma,  Arizona,  on  19 
November  1998.  These  intersriews  provided  much  the  same  information  on  situation  awareness 
needs  as  the  interviews  with  the  Abrams  tank  commanders. 

Physical  inspections  of  an  M  IA2  Abrams  tank  were  performed  at  Fort  Knox  on  26,  27  August 
1998  and  8  September  1998  (Figure  3),  and  at  Aberdeen,  Maryland  on  16  April  1999.  The 
inspections  consisted  of  climbing  inside  and  outside  the  vehicle;  trying  out  all  the  possible 
positions  assumable  by  the  various  crew  members  and  noting  their  respective  displays,  controls, 
and  sight  lines  outside  the  vehicle;  trying  out  the  various  hatch  positions;  taking  photographs  of 
the  inside  and  outside  of  the  vehicle;  making  detailed  measurements  of  critical  dimensions;  and 
witnessing  the  operation  of  the  CITV  Forward-Looking  Infrared  Sensor  (FLIR).  The  inspection 
on  8  September  1998  included  a  ride  in  a  moving  Ml  A2  (Figure  4),  which  allowed  observing  the 
commander  perform  his  duties  and  experiencing  tank  motion  dynamics  from  the  commander’s 
station  and  the  gunner’s  seat. 

Physical  inspection  of  a  Bradley  BFIST  was  performed  at  Fort  Sill  in  June  1997.  Additional 
inspections  of  Bradley  M2A2's  and  Bradley  M2.A3’s  were  performed  at  United  Defense  Limited 
Partnership  (UDLP)  in  San  Jose,  California,  on  13  October  1998,  and  during  an  FBCB2  Limited 
User  Test  at  Yuma,  Arizona,  on  19  November  1998  (Figure  5),  The  inspection  on  19  November 
1998  included  a  ride  in  a  moving  Bradley  M2A2,  with  the  opportunity  to  observ'e  the 
commander’s  tasks  and  to  experience  motion  dynamics  from  the  passenger  and  commander’s 
positions.  Physical  inspections  of  an  Ml  13  were  performed  at  the  Minnesota  National  Guard  in 
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New  Brighton,  Minnesota,  on  14  October  1998  (Figure  6)  and  again  on  November  1998. 
Information  similar  to  that  described  earlier  for  the  Abrams  tank  was  obtained. 


Figure  3.  Ml  A1  at  Fort  Knox  26  Aug  98  Figure  4.  Ml  A 1  at  Fort  Knox  8  Sep  98 


Figure  5.  Bradley  at  Yuma  19  Nov  98  Figure  6.  Ml  13  at  New  Brighton  14  Oct  98 

Readers  interested  in  making  their  own  physical  inspections  of  an  Abrams  M  l  A2  and  a  Bradley 
M3A3  can  do  so  by  visiting  the  .Army’s  web  site  at  ww'w.goarmy.com/tour/adv/tank.htm  and 
w'W'w.goarmy.comhour/adv/bradlcN'.htm. 

Further  information  on  armored  vehicles  and  the  situation  aw'arencss  needs  of  an  armored 
vehicle  commander  was  obtained  from  the  following  sources; 

•  contractor  technical  reports  from  the  Combat  Vehicle  Crew  (CVC)  program, 

•  review  of  U.  S.  Army  technical  manuals  describing  the  M1A2,  M3A2,  M2A2  ODS 

(Operation  Desert  Stomi).  and  Ml  13  Army  vehicles, 

•  information  from  U.  S.  Army  program  offices,  LI.  S.  Army  Battle  Labs,  and  U.  S.  Army 

contractors  available  on  the  World  Wide  Web, 

•  information  from  U.  S.  Army  program  offices  and  LI.  S.  Army  government  contractors 

provided  at  AUSA  exhibitions, 

•  literature  surs'ey  consisting  of  the  last  five  years  of  articles  from  the  following  sources: 

-  Jane’s  International  Defense  Review^ 

-  Jane’s  Defense  Weekly 
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-  Jane’s  Defense  Systems  Modernization 

-  Armada 

-  Defense  Week 

-  U.  S.  Army  Times 

-  National  Defense 

-  Society  of  Photo-Optical  and  Instrumentation  Electronics  (SPIE)  papers 

-  Aviation  Week  and  Space  Technology 

-  Assorted  books  on  armored  vehicles: 

•  MI  Abrams  by  Steve  Zaloga  and  Peter  Sarson  (New  Vanguard  Series 
by  Osprey  Publishing  Ltd,  Great  Britain) 

•  M2  /  MB  Bradley  by  Steve  Zaloga  and  Peter  Sarson  (New  Vanguard 
Series  by  Osprey  Publishing  Ltd,  Great  Britain) 

•  Armored  Cav:  A  Guided  Tour  of  an  Armored  Cavalry  Regiment  by 
Tom  Clancy  (Berkeley  Publications  Group,  USA) 

•  scale  models  of  the  M1A2,  M2A2,  and  Ml  13  Army  vehicles. 

Information  relating  to  sensors  and  displays  on  armored  vehicles  was  obtained  from  the  above 
sources  with  the  addition  of  the  following  material: 

•  information  from  sensor  and  display  vendors  available  on  the  World  Wide  Web, 

•  literature  sur\'ey  consisting  of  the  last  five  years  of  articles  from  the  following  sources: 

-  Unmanned  Vehicles  (Shephard  Press) 

-  Defense  Helicopter  (Shephard  Press) 

-  Helicopter  World  (Shephard  Press) 

-  Interavia  (Aero.space  Media  Publishing) 

-  Society  for  Information  Display  (SID)  Proceedings. 

Information  from  these  sources  w'as  cross-correlated  for  accuracy  and  then  published  in  an 
interim  report  for  this  program,  dated  December  1998.  The  following  discussion  summarizes  the 
findings  of  this  user  needs  survey. 


As  a  result  of  the  U.  S.  Army’s  initiatives  to  “own  the  night”  and  to  “increase  the  situation 
awareness  of  Army  commanders”  via  networked  battle  management  systems,  the  U.  S.  Army  is 
adding  to  its  armored  vehicles  a  suite  of  electronic  systems  to  enhance  their  lethality  and 
survivability  (Table  1).  Some  of  these  systems,  such  as  the  Driver’s  Vision  Enhancer  (Figure  7), 
the  Gunner's  primary  sight,  and  the  Battlefield  Combat  Identification  System,  give  drivers  and 
gunners  more  advanced  tools  for  performing  existing  tasks.  Other  systems,  such  as  the 
Commander’s  Independent  Thermal  Viewer,  and  the  FBCB2  Tactical  Terminal,  give  vehicle 
commanders  entirely  new  tasks  and  capabilities.  The  commander’s  independent  thermal  viewer 
on  the  M1A2  Abrams,  for  example,  allows  the  commander  to  hunt  for  new  targets  while  the 
gunner  is  dispatching  an  existing  target,  a  capability  that  was  not  present  on  the  MlAl.  While 
this  provides  up  to  a  60%  improvement  in  the  effective  rate  of  fire,  it  may  divert  the 
commander’s  attention  from  other  essential  tasks  such  as  vehicle  navigation  or  vehicle 
communication.  In  this  case  the  commander’s  heavy  workload  is  further  increased. 

Another  system  that  increases  the  vehicle  commander’s  workload  is  the  FXXl  Battle  Command 
Brigade  and  Below  (FBCB2)  tactical  terminal.  This  networked  computer  system  provides 
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increased  situation  awareness  in  the  form  of  rapid  accessibility  to  enemy  and  friendly  positions, 
topographical  maps,  commander’s  orders,  situation  reporting,  and  vehicle  needs/status  reporting. 
The  situation  awareness  data  allows  the  commander  to  make  more  informed  and  rapid  decisions 
prior  to  and  during  an  enemy  encounter.  But  interaction  with  the  digital  terminal  requires  the 
commander  to  view'  the  display  inside  the  vehicle,  while  many  of  his  other  duties  require  his 
attention  to  be  outside  the  vehicle. 

Table  1 .  New  and  improved  electronics  for  Army  vehicles 


Electronic  System 

Description 

Use 

Commander’s  Independent  ; 
Viewer 

8-12  micron  2”‘'*  generation  FLIR  sensor 

Target  hunting 
(Commander) 

FBCB2  Tactical  Terminal 

Networked  Applique  or  embedded 
computer 

Situation  awareness 
(Commander) 

GPS  Navigation  System 

Precision  lightweight  GPS  receiver 
(PLGR) 

Navigation 
(Cmdr  &  driver) 

Driver’s  Vision  Enhancer 

8-12  micron  uncooled  Infrared  sensor 

Terrain  viewing 
(Driver) 

Gunner’s  Primary  Sight 

8-12  micron  2'*‘^  generation  FLIR  sensor 

Target  sighting 
(Gunner) 

Battlefield  Combat  ID 
System 

Ka-band  narrow  beam  interrogator  plus 
omni-directional  receiver  /  transponder 

Friend/foe  ID 
(Gunner) 

(a)  sensor  and  display  (b)  installation  in  HMMWV 

Figure  7.  Driver’s  Vision  Enhancer 


The  commander’s  workload  is  stressed  the  most  in  the  case  of  turreted  amiored  vehicles  such  as 
the  Abrams  and  the  Bradley.  When  not  engaging  the  enemy,  the  vehicle  commander  is  trained  to 
stand  in  the  hatch  w'hile  the  vehicle  is  moving  and  to  search  continuously  for  road  hazards, 
ground-based  threats,  friendly  forces,  and  other  objects  or  situations  that  might  affect  his  vehicle. 
He  is  constantly  giving  verbal  commands  over  the  vehicle’s  intercom  system  to  tell  the  driver  to 
turn  right  or  left  or  the  gunner  to  slew  the  turret  right  or  left.  While  standing  in  the  hatch  he  is 
unable  to  use  the  commander’s  independent  thermal  viewer  (CITV)  or  the  FBCB2  tactical 
terminal  because  their  displays  are  viewable  only  while  inside  the  turret.  This  makes  it  difficult 
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to  prepare  situation  reports  while  maintaining  outside  awareness.  It  may  even  cause  him  to  miss 
a  critical  communication  from  his  commander. 

When  engaging  the  enemy  and  the  vehicle  is  buttoned  up,  the  situation  is  reversed.  In  this  case, 
the  CITV  display  and  the  FBCB2  tactical  terminal  are  directly  viewable,  but  the  commander  has 
little  awareness  of  the  vehicle’s  immediate  surroundings  or  its  turret-hull  orientation.  The 
commander's  independent  thermal  viewer  is  excellent  for  acquiring  targets  at  longer  ranges,  but 
its  narrow  field  of  view  (13.3°x7.5°  maximum)  and  limited  slew  rate  (607sec)  are  not  well 
matched  to  seeing  threats  at  nearby  ranges  {<  400  meters).  The  commander’s  viewing  ports  are 
intended  to  provide  such  a  capability,  but  are  limited  to  visible  light  only  and  are  frequently 
taped  over  at  night  to  preclude  the  enemy  from  spotting  the  vehicle  due  to  light  emanating 
through  the  ports. 

The  \ehiclc  commander’s  needs  obtained  in  this  survey  are  summarized  in  Figure  8.  Basically, 
tile  \ehicic  commander  needs  a  way  to  see  the  FBCB2  and  CITV  displays  inside  the  vehicle 
when  Ids  head  is  outside  the  vehicle,  and  a  way  to  see  the  vehicle’s  immediate  surroundings 
outNidc  u  hiic  his  head  is  inside  the  vehicle.  It  is  frequently  necessary  for  the  commander  to  have 
h>  ruMvi  ollt^ide  the  \'chiclc  to  .search  for  airborne  threats  and  threats  in  nearby  tree  line-s,  and  to 
make  vure  that  the  vehicle  does  not  get  into  compromising  situations  wdth  terrain  hazards  or 
cac.ve  dau'.age  tc  nearby  friendly  vehicles,  infantry,  or  man-made  structures.  Therefore,  the 
c.’uuuar'.vier  is  trained  to  keep  his  head  outside  of  the  vehicle  at  all  times  while  it  is  moving 
e\eep:  u  aer.  iie  expects  direct  fire  from  the  enemy.  Specifically,  he  is  taught  that  the  only  way 
ka.'u  :i;e  crieniation  of  the  vehicle’s  turret  with  respect  to  the  hull  is  to  have  his  head  outside 
ii'.e  -ve.-.ieie  arid  ti'  observe  directly  the  turret's  orientation  with  respect  to  the  hull  or  with  respect 
'.ae  ga-aad  :uo\  ing  by. 

Tile  aeeeis  enecaintered  in  this  user  survey  have  been  documented  in  an  official  U.  S.  Army 
a-vaiaea;  er.atied  'T'-scr  Functional  Description  accompanying  the  Force  XXI  Brigade  and 
Bei.'u  ( )pera:icinai  Requirements  Document,  Version  5.2,  Change  1,  dated  23  July  99’'.  In 
.•Xppea.viix  B  el  that  document,  titled  Displays,  it  is  stated  that  “a  HMD  is  required  so  that  the  BC 
Br..d;e>  Commander)  will  be  provided  with  acce.ss  to  (FBCB2-provided)  situational  awareness 
wi-.iie  \ieu;ng  outside  the  turret.  It  is  required  that  the  BC  have  situation  aw'areness  (e.g,, 
Heime;  Mounted  Display)  both  in.side  the  turret  and  while  viewing  outside  the  turret”. 
.Addition...  paragraphs  document  similar  needs  for  the  Abrams  tank  commander,  the  Bradley 
Linenaeker  eommandcr.  and  the  squad  leader  in  the  Bradley  Fighting  Vehicle. 

Ha\-ing  established  the  situation  aw^areness  needs  of  the  vehicle  commander  in  terms  of 
information,  it  is  now  possible  to  translate  these  needs  into  STTV  system  requirements  by 
looking  at  the  vehicle  commander’s  sensors,  di.splays,  and  interfaces.  The  .sensors  and  displays 
•  availahie  to  the  commander  on  the  Abrams  and  the  Bradley  are  shown  in  Table  2.  Although  the 
Abrams  and  Bradley  displays  differ  noticeably  in  design,  their  performance  characteristics  are 
similar  at  any  given  time.  Furthermore,  as  the  vehicles  are  upgraded  to  newer  models,  the 
imaging  .sensors  and  situation  awareness  systems  are  upgraded  to  newer  models  as  w^ell.  At  any- 
given  time  one  may  find  in  the  field  vehicles  of  all  upgrade  types.  However,  it  is  the  Army’s 
goal  to  eventually  upgrade  each  vehicle  to  the  latest  standard  shown  in  the  right  hand  column  of 
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Table  2.  Therefore,  it  is  safe  to  establish  the  STTV  systern  requirements  using  the  characteristics 
shown  in  the  right  hand  column  of  Table  2. 


♦  Provide  the  vehicle  commander  increased  situation  awareness  of  the  vehicle’s  surroundings 
while  inside  the  vehicle  or  while  standing  in  an  open  hatch.  This  is  needed  for: 

-  Detection  of  terrain  hazards  to  help  the  commander  aid  the  driver, 

-  Detection  of  nearby  friendly  forces  and  environmental  structures, 

-  Detection  of  nearby  ground  threats, 

-  Display  of  information  from  the  commander’s  independent  thermal  viewer  and 

tactical  display, 

-  Display  of  UAV  imagery. 

•  Provide  this  increased  situation  awareness  under  day,  night,  and  all-weather  conditions  when 
the  commander's  vision  blocks  must  be  covered  and  the  vehicle’s  hatches  mu,st  be  buttoned 
up. 


Figure  8.  Vehicle  commander’s  needs  from  user  survey 


3.2  System  Requirements  Specification 

Based  on  the  information  collected  in  the  user  surv'ey  described  in  Section  3.1,  a  System 
Requirements  Specification  was  developed.  The  specification  describes  the  needs  encountered 
in  the  user  survey  and  postulates  a  system  having  a  sensor,  a  helmet-mounted  display,  and  a  head 
tracker  (Figure  9).  The  sensor  is  required  wdien  the  system  is  deployed  on  a  vehicle  that  lacks  its 
own  night  vision  sensor,  such  as  an  Ml  13  or  MIAl.  It  is  also  required  on  vehicles  already 
having  a  commander’s  independent  .sensor  because  the  slew'  rate  of  the  existing  sensor  is  too 
.slow  to  match  normal  head  motion  (-ISOVsecond  required),  and  the  field  of  view  is  too  small  to 
cover  a  large  search  area  quickly.  The  required  performance  capabilities  of  the  .sen.sor,  display, 
and  situation  awareness  system  are  shown  in  Figure  10.  The  complete  specification  is  included 
in  Appendix  1  of  this  report. 


Commander  can  view 
the  surrounding  terrain 
in  any  direction  from 
inside  the  vehicle  using 
the  helmet-mounted 
display 


Commander  can  see 
F8C82  data  and 
CITV  imagery  while 
standing  in  the 
hatch. 


ZSO""  panoramic  image  sensor  with 
helmet-mounted  display  and  head  tracker 


Helmet-mounted  display 
can'  be  used: 

•  in  open  hatch 
when  buttoned  up 
while  0^  the  vehicle 
{via  personal  radio 
frequency  link)  to 
view: 

-  FBC82  data 
~  CfTV  imagery 

-  maintenance  and 
repair  data 


Figure  9.  Envisioned  see-through  turret  visualization  system 
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Table  2.  Commander’s  sensors  and  displays  on  the  Abrams  and  the  Bradley 


Vehicle  M 1 A 1  -D  Abrams 


Abrams 

Displays 


M1A2  Abrams 


Vehicle 


Bradley 

Displays 


St  _ 

1%:  5,5  •”  4 


Imaging 

Sensor 

Characteristics 


?3'rCT"ai 


cws 

2Crxl5%3X) 
day  only 


CITY 

75"'x!5^''  C3X)  WFOV 
2.5"a5"{  lOX  NFOV 

V. 


CIV 

:>A^^%6.m2X)  WFOV 
Li^x2.r(6X)NFOV 


Imaeino; 


Ui  splay 
Characteristics 


Situation 

Awareness 

Display 

Characteristics 


r^gen  FUR 
8-12  urn 
O.rCNETD 
no  zoom 

tgl  del  8l  recog  to  -*-2000  m 
6DYscc  slew  rate 

continuous,  preset,  or  manual  rotation 
slew  to  cue  function 
4:3  aspect  ratio 
RS-33()  output 


CID 

analog  x  480  lines 
4:3  aspect  ratio 
square  pixels 

_ _ monochrome _ 

IVIS  /Applique 

640  X  480  (VGA) 

RS«  170  output 
color 


CITY  &  CIV 

1 (3X*6X)  WFOV 
3.6"x2.(rn3X25X.S0X)  NFOV 
2'“^  gen  FLIR 
8-12  pm 
O.OrCNBTD 
2x  and  4x  zoom 
tgl  del  Sl  recog  to  -4000  m 
60^/sec  slew  ratc- 
cominuous,  preset,  man  rotation 
slew  to  cue  function 
1 6:9  and  4:3  aspect  ratio 
modified  RS- 1 70  output 


CDU 

1316  x48C)  pixels 
.1 6:9  aspect  ratio 
non-square  pixels'^' 
monochrome 


FBCB2 /Appliques 
CIV  Sc  DVB  also  displayed 
800  X  6(X)  (SVGA)  ^ 
RS-170  output 
color 


’^special  display  required  or  warper  required  with  1 : 1  pixel  display 
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Figure  iO.  Required  system  performance  capabilities 

Section  3.3  Trade  Studies 

Trade  studies  were  conducted  to  arrive  at  a  system  design  that  provides  the  best  possible 
response  to  the  system  requirements.  Figure  11  lists  the  trade  studies  that  were  performed. 
Results  are  described  in  the  following  subsections. 

•  Sensor 

-  Panoramic  sensor  approach 

-  Camera  type 

-  Gimbaled  sensor  approach 

-  Sensor  resolution  versus  wavelength 

•  Helmet-mounted  display 

-  Monocular  versus  biocuiar  approach 

-  Color  versus  monochrome  approach 

-  Direct  view  versus  see-through  approach 

-  Land  Warrior  compatibility  approach 

•  Head  tracker 

•  Demonstration  vehicle 

•  Vehicle  interface 

-  Sensor  location  on  M I A2 
~  Controls  on  M1A2 

-  Sensor  location  on  M 1 1 3 

Figure  1 1 .  Trade  studies  conducted 

3.3.1  Panoramic  Sensor  Approach  Trade  Study 

This  trade  study  considered  panoramic  sensor  approaches  as  a  means  of  addressing  the  system 
requirement  for  a  360°  field  of  regard  sensor.  Panoramic  sensor  approaches  were  initially 
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considered  to  be  superior  to  scanned  sensor  approaches  because  of  their  lower  latency  when  used 
with  a  head  tracker.  The  trade  study  was  limited  to  commercially  available  panoramic  sensors 
because  of  the  desire  to  conserve  program  funding. 

Table  3  show's  the  ten  different  panoramic  sensor  approaches  considered.  These  approaches 
represented  all  the  commercially  available  panoramic  sensor  approaches  available  at  the  time  the 
tradeoff  study  was  performed.  These  approaches  were  evaluated  relative  to  the  foilow'ing 
criteria: 

1 )  field  of  regard 

a)  azimuth  field  of  regard 

b)  elevation  field  of  regard 

2)  sensor  resolution 

a)  number  of  cameras 

b)  camera  lens  field  of  view 

c)  pixels  per  camera 

3)  absence  of  parallax  between  adjacent  cameras  due  to  the  physical  displacement  of  the 
camera  focal  points 

4)  obscuration  of  the  field  of  regard  by  required  mounting  hardware 

5)  ability  to  separate  the  unit  into  separate  cameras  to  simplify  mounting  on  multiple 
vehicles 

6)  modifications  required  to  upgrade  the  sensor  to  8- 12  jim  w'avelength 

7)  relative  size  and 

8)  relative  cost. 

All  of  the  single  camera  approaches  w'erc  eliminated  immediately  becau.se  they  lacked  the 
resolution  achievable  by  the  multiple  camera  approaches,  particularly  in  the  vertical  direction. 
The  remaining  multi-camera  approaches  w'ere  similar  in  their  ability  to  achieve  improved 
resolution  and  zero  ob.scuration.  The  IPIX-like  approach  with  its  wide-angle  fisheye  lenses  w'as 
preferred  initially  because  of  its  small  size,  low  cost,  and  potential  ability  to  separate  it  into 
multiple  cameras  that  could  be  distributed  around  the  vehicle.  Therefore,  an  IPIX-like  approach 
using  eight  CCD  cameras  with  58°  FOV  lenses  was  selected  in  Phase  I  of  the  program  for  the 
baseline  system  design.  However,  during  Phase  11  of  the  program,  feedback  from  image 
processing  engineers  during  the  sensor  design  task  noted  that  an  IPIX-like  approach,  when  scaled 
up  to  make  use  of  commercially  available  cameras,  produced  a  noticeable  parallax  between  the 
images  from  two  adjacent  cameras.  The  parallax  was  caused  by  the  physical  separation  of  the 
focal  points  of  the  adjacent  cameras,  and  led  to  similar  objects  in  the  adjacent  images  being 
displaced  laterally  by  amounts  proportional  to  the  camera  focal  point  separation  and  the  range  of 
the  objects  from  the  sensor.  The  variation  of  object  displacement  wdth  range  made  it  impossible 
to  stitch  together  the  images  from  adjacent  cameras  to  produce  a  seamless  360°  panoramic 
image.  This  parallax  could  be  minimized  to  the  point  of  being  unnoticeable  by  using  an  IPIX- 
like  approach  wdth  the  camera  .separation  kept  small  by  camera  miniaturization.  How'ever,  this 
was  not  compatible  with  the  use  of  commercially  available  low  cost  CCD  cameras.  Therefore,  it 
was  decided  to  use  a  PVSl-type  approach  wdth  tilted  mirrors  along  with  off-the-shelf  CCD 
cameras. 
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able  3.  Candidate  panoramic  sensor  approaches 


3.3.2  Camera  Wavelength/Resolution  Trade  Study 

The  choice  of  a  PVSI-type  approach  with  separate  cameras  gives  one  the  flexibility  to  select  the 
wavelength  and  resolution  of  the  cameras  to  be  used  in  the  overall  panoramic  camera  unit. 
Figure  12  shows  the  range  of  possible  camera  types  plotted  versus  camera  wavelength  and 
resolution.  Details  of  the  cameras  included  in  each  of  the  ovals  can  be  found  in  the  Phase  I 
interim  report.  Solid  ovals  represent  classes  of  cameras  already  available  while  dotted  ovals 
represent  classes  of  cameras  currently  in  development  but  available  at  the  time  of  writing. 

The  system  requirements  suggest  that  the  preferred  camera  approach  should  lie  as  close  as 
possible  to  the  upper  right  hand  comer  of  Figure  12.  This  agrees  with  the  selection  by  the  U.  S. 
Army  of  the  Horizontal  Technology  Integration  (HTI)  second  generation  FLIP  as  the  sensor  of 
choice  for  its  attack  helicopters  and  armored  vehicles.  The  next  best  sensor  is  a  third  generation 
staring  HgCdTe  FLIP,  which  is  also  currently  in  development.  This  sensor  will  not  replace  the 
HTI  second  generation  FLIP,  however,  until  its  resolution  can  be  improved  to  2048x2048  pixels. 
All  of  the  HgCdTe  sensor  approaches  in  Figure  12  are  too  expensive  for  the  current  STTV 
program,  especially  w'hen  it  is  considered  that  at  least  four  .sensors  are  needed  to  obtain  a  360® 
field  of  regard  using  a  panoramic  camera  approach. 

This  leaves  one  with  the  choice  of  using  visible  Charge  Coupled  Device  (CCD)  sensors  or  a 
lower  resolution  8-12  pm  infrared  sensor.  Since  both  high  resolution  and  8-12  pm  infrared 
sensitivity  are  needed  to  meet  the  STTV  system  requirements,  it  was  decided  to  use  eight 
standard  resolution  visible  cameras  in  the  panoramic  camera  unit  along  with  a  ninth  8-12  pm 
infrared  sensor  in  a  scanned  sensor  unit  that  could  be  superimposed  on  the  panoramic  camera 
image.  The  sensors  that  were  chosen,  therefore,  were  eight  640x480  pixel  CCD  cameras  for  the 
panoramic  camera  unit  and  one  320x240  pixel,  microbolometer  camera  for  the  scanned  camera 
unit. 

3.3.3  Gimbaled  Sensor  Approach  Trade  Study 

Having  introduced  the  need  for  a  scanned  8-12  pm  infrared  sensor,  a  second  tradeoff  study  was 
conducted  to  find  the  best  possible  gimbaled  sensor  unit  for  the  STTV  program.  This  required 
finding  both  an  IP  camera  and  a  gimbaled  scanner  that  could  be  mounted  on  an  armored  vehicle. 
The  STTV  requirements  in  this  case  were  very  similar  to  the  requirements  for  a  payload  sensor 
onboard  a  helicopter  or  unmanned  aerial  vehicle  (U.A.V).  The  tradeoff  study,  therefore, 
considered  all  the  possible  gimbaled  sensor  payload  packages  that  could  be  found  onboard  these 
vehicles. 

Candidate  gimbaled  sensor  approaches  are  shown  in  Table  4.  This  table  represents  the  complete 
set  of  gimbaled  sensor  payload  packages  available  at  the  time  the  trade  study  was  performed 
(4Q98).  Table  5  shows  the  leading  candidates  from  Table  4  based  on  smallness  of  size  and  fast 
gimbal  slew  rate.  The  most  attractive  of  these  candidates  for  the  STTV  system,  based  on 
smallness  of  size,  fast  gimbal  slew  rate,  and  lowest  cost,  was  the  Nytech  gimbal  using  a  320x240 
pixel  microbolometer  sen.sor. 
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Figure  1 2.  Candidate  sensors  versus  wavelength  and  resolution 


Tabic  4.  Gimbaled  sensor  payloads 


Table  4.  Ginibaled  sensor  payloads  (continued) 


_ 16”  hi _ 

Biclops  TRAC  Labs  LI  kg  120’Vscc 


'Fable  5.  Giinbaled  sensor  approaches 


The  complete  sensor  approach  for  the  STTV  program,  based  on  the  trade  studies  conducted 
above,  is  shown  in  Figure  13.  A  panoramic  sensor  unit  provides  a  low  latency  view  of  the 
vehicle's  surroundings  to  give  an  idea  of  the  nearby  terrain  and  the  locations  of  larger  objects  for 
good  situation  awareness.  A  gimbaled  sensor  unit  provides  high  resolution  detail  sufficient  to 
detect  smaller  objects  such  a.s  a  crouching  enemy  troop  at  400  yards.  The  commander  sees  on 
his  helmet-mounted  display  a  26'’x  l9^  segment  of  the  panoramic  image  along  with  a  higher 
resolution  ]5.5®x]  1.6°  image  from  the  gimbaled  .sensor.  By  moving  his  head  he  is  able  to  pan 
and  tilt  the  26“xl9'’  segment  of  the  panoramic  image  with  near-zero  latency,  keeping  the 
15.5°xll.6°  image  insert  in  the  center  of  the  field  of  view.  The  26°xl9°  segment  of  the 
panoramic  image  uses  CCD  sensors  with  sensitivity  in  the  visible  region  of  the  spectrum.  The 
1 5.5“xl  1.6°  image  from  the  gimbaled  sensor  uses  a  microbolometer  sensor  and  is  sensitive  in  the 
8-12  Lim  region  of  the  spectrum.  Together,  the  two  sensors  provide  a  fused  representation  of  the 
15.5°xl  1 .6°  field  of  view  that  enables  improved  detection  over  either  approach  separately. 


◄ - 

t 

Panoramic  Sensor  Unit 

360*x42°  FOV  (26"x19'’  sub  FOV  displayed) 
CCD  now  (ICCD  or  HgCdTe  FPA’s  in  future) 

Electronic  pan,  tilt,  zoom  _ 

Multiple  simultaneous  users  * 

Provides  low  latency  view  of  surroundings 


Scanned  Sensor  Unit 

15.5"x11.6°  FOV 
LWIR  sensor 

320x240  pixels  now 
640x480  pixels  in  future 
Mechanically  scanned  gimbal 
Provides  high  resolution  detail 


Figure  13.  Complete  STTV  sensor  approach 


There  are  several  advantages  to  this  hybrid  sensor  approach.  One  advantage  is  that  the  gimbaled 
sensor  can  be  replaced  by  a  second  generation  FLIR  sensor  if  the  vehicle  already  has  this 
superior  sensor.  This  lowers  the  insertion  cost  of  the  STTV  system  while  providing  all  of  the 
advantages  of  increased  situation  awareness  that  the  full  STTV  system  provides.  Another 
advantage  is  that  a  second  user  on  the  vehicle  can  view  the  data  from  the  panoramic  sensor  on  a 
separate  helmet  mounted  display  frorp  the  vehicle  commander  while  allowing  both  users  to  pan 
and  tilt  within  the  panoramic  image  independently.  This  allows  the  squad  leader  in  the  back  of 
an  infantry  fighting  vehicle,  such  as  a  Bradley,  to  survey  the  area  surrounding  the  vehicle  prior  to 
exiting,  and  to  do  this  independently  of  the  vehicle  commander,  who  is  more  concerned  with 
finding  objects  that  affect  the  vehicle  safety,  A  third  advantage  is  that  as  Intensified  CCD 
(ICCD)  cameras  and  HgCdTe  focal  planes  improve  in  resolution  and  lower  in  co.st,  the 
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panoramic  sensor  can  be  improved  with  these  better  sensors.  The  ultimate  improvement  is  to 
have  a  panoramic  sensor  composed  of  HgCtTe  focal  planes  that  has  a  resolution  equal  to  or 
better  than  the  current  second  generation  FOR  unit.  In  this  case,  one  can  dispense  with  the 
second  generation  FOR  unit  on  a  vehicle  and  use  only  the  HgCdTe  panoramic  sensor  unit  for 
both  targeting  and  situation  awareness.  This  is  an  attractive  option  for  vehicles  such  as  the  FSCS 
and  FCS  currently  in  development. 

3.3.4  Sensor  Resolution  Versus  Wavelength  Trade  Study 

Figure  14  shows  the  detector  resolution  of  the  resulting  hybrid  sensor  approach  versus  the  STTV 
system  requirements.  The  data  supporting  this  figure  are  included  in  Table  6.  Figure  13  shows 
that  none  of  the  current  panoramic  camera  approaches,  including  the  mirrored  PVSI  approach 
using  eight  640x480  pixel  CCD  cameras,  currently  meets  the  user  requirement  of  detecting  a 
human  target  at  400  yards.  The  PVSI  approach  does  meet  the  need  for  a  wide  field  of  view 
situation  awareness  sensor  at  low  latency.  By  adding  a  gimbaled  sensor  to  the  panoramic  sensor 
one  can  improve  the  resolution  of  the  combined  sensors  so  that  the  combination  can  meet  both 
the  resolution  requirement  and  the  wavelength  requirement.  Figure  14  shows  that  a  320x240 
pixel  microbolometer  sensor  with  a  26'^'xl9°  field  of  view  is  insufficient  for  this  purpose.  Merely 
improving  its  resolution  to  640x480  pixels  while  keeping  the  field  of  view  the  same  does  not 
improve  it  enough  to  meet  the  requirement.  However,  a  320x240  pixel  microbolometer  sensor 
with  I5.5°xll.6'’  FOV  optics  will  meet  the  detection  requirement,  and  an  improved  640x480 
pixel  microbolomcter  sensor  will  almost  alkw  one  to  recognize  a  human  target  at  the  same 
distance  (not  a  requirement  at  this  time).  The  penalty  is  a  smaller  field  of  view,  which  is 
regained  by  adding  the  panoramic  camera  portion  of  the  hybrid  sensor  approach.  Figure  14 
shows  that  both  the  first  and  second  generation  FLIRs  can  meet  the  detection  requirement  and 
al.so  recognize  the  object  as  a  human  target.  However,  their  field  of  view  is  only  10®x7‘’  or  even 
smaller,  so  they  also  must  be  augmented  by  a  panoramic  camera  approach  to  meet  the  need  for 
improved  situation  awareness.  Therefore,  they  can  be  used  in  place  of  the  microbolometer 
sensor  in  the  proposed  hybrid  approach  but  hot  in  place  of  the  panoramic  camera  component. 

It  is  interesting  to  note  that  a  division  of  the  Boeing  Corporation  (formerly  Rockwell  Inc)  is 
currently  developing  HgCdTe  staring  focal  planes  with  partial  support  from  ONR  and  has 
identified  the  objective  of  creating  a  panoramic  .sensor  using  this  technology.  By  using  eight 
2048x2048  pixel  focal  planes  in  a  panoramic  camera,  one  can  obtain  a  resolution  nearly  as  good 
as  the  current  first  generation  FLIR,  and  sufficient  for  both  human  object  detection  and 
recognition.  Since  this  .sensor  will  have  a  full  360°  field  of  view,  one  would  need  only  this 
panoramic  camera  to  meet  the  current  STTV  requirements.  Honeywell’s  propo.sed  hybrid  sensor 
approach  provides  an  upgrade  path  which  can  incorporate  this  new  technology  development. 

3.3.5  Monocular  Versus  Biocular  HMD  Trade  Study 

A  trade  study  was  performed  to  determine  whether  a  monocular  approach  or  a  biocuiar  approach 
would  be  the  best  HMD  choice  for  the  STTV  system.  Table  7  shows  the  advantages  and 
disadvantages  of  a  monocular  approach  versus  a  biocular  approach.  A  binocular  approach  was 
included  in  the  trade  study  for  completeness.  When  considering  the  display  of  digital 
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information  from  an  IVIS  type  of  system,  the  field  of  view  is  unimportant,  and  the  prefeired 
approach  is  clearly  a  monocular  approach  with  the  advantages  as  shown  in  Table  7. 


Recogntee  target  at  400  it^eters 


Detect  human  target  at  400  meters 

8(7$Sx494)/3$0';^i  ! 

“UKxTK)}360'‘'(O^4iiKx^^^^ 
4(768x494)/360”  0/j^  4{7$8x494) 

0  {lj|  1(1Kx1K)/360‘*  (Tj 


GCD 


ICCD 


HTI  FOR 
1315x480/10“’ 


1st  Gen  FUR 

Panoramic  Camera  * 
$40x460  uhoi  /10* 


320x240  ubol 


320x240  ubo!  MO* 


LWIR 


Detector  Sensitivity 


Figure  14.  Detector  resolution  versus  requirements 
Table  6.  Detector  resolution  versus  requirements 


Sensor 

Pixels 

Simple  panoramic  camera 

1(1024x1024) 

DVE  (current) 

320x240 

4  fisheye  lenses  1 

4(768x494) 

4  ftsheye  lenses 

4(1024x1024) 

DVE  (iiiUire) 

640x480 

Tsight  camera 

8(768x494) 

Microholomcter  (current)  1 

320x240 

Microbolameter  (future) 

640x480 

Boeing  panoramic  camera 

4(64()x480)«“ 

generation  FUR 


generation  FLIR 


6x4& 


Detection  of  human  target  ((.).5mx  L5ni  )  at  400  meters  (1  cvcie  across  lariret) 


Recoirnition  of  human  target  (0.5mxL5m  )  at  4(K)  meters  (2  cycles  across  target) 


Split  apeniturc  optics  used  to  diplex  two  a/Jjrmthal  fields  onto  separate  halves  of  each  FFA 


When  considering  the  display  of  sensor  information,  the  tradeoff  is  more  complex  because  it  is 
clearly  advantageous  to  have  the  widest  possible  field  of  view  for  greater  situation  awareness. 
The  field  of  view  achievable  by  a  partially  overlapped  biocular  approach  can  be  as  great  as  50° 
to  10°  wdth  40®  FOV  optics  for  each  eye,  W'hile  the  maximum  field  of  view  of  a  monocular 
approach  is  only  about  40®.  However,  Honeywell’s  experience  with  the  Apache  IHADDS  HMD 
display  is  that  the  additional  10°  to  30°  of  field  of  view  achievable  is  not  worth  the  additional 
disadvantages  shown  in  Table  7  for  a  biocular  or  binocular  display.  Therefore  a  monocular 
approach  was  selected  for  the  STTV  HMD  display. 


Table  7.  Monocular  versus  biocular  HMD  approach 


Monocular 

Biocular 

Binocular 

Advaniagc.s 

Maintains  dark  adapted  eye 

-  Improves  vehicle  safety 

-  Allows  view  of  vehicle 
displays  and  outside 
environment 

Lowc>st  head  mounted  weight 
Lowest  cost 

-  No  critical  alignment 
Lowest  risk 

Highest  reliability 

Operational  product 
experience 

Visual  comfort 

Improved  signal  to  noise 
Widest  FOV  potential  with 
partial  overlap 

Redundant  image  displays 
Lower  training  requirements 

Stereo  capability 

Visual  comfort 

Improved  signal  to  noise 
Moderately  wide  FOV 
potential 

Redundant  images 

Lower  training  requirements 

Disadvantages 

increased  training 
requireinents 

Visual  discomfort,  rivalry 
Nan-symmetrical  center  of 
gravity 

Limited  field  of  view 

No  dark  adapted  eye 

High  head  mounted  weight 
Difilcult  alignment  during 
construction 

;  More  sensitive  to  optical 
aberations 

IPD-cxit  pupil  adjustment 
issue 

Helmet  stability  critical 
Higher  cost  than  monocular 
'  Less  reliable  than 
monocular 

Complex  sensor  requirements 
No  dark  adapted  eye 

High  head  mounted  weight 
Difficult  aiignmeni  during 
construction 

Most  sensitive  to  optical 
aberations 

IPD-exit  pupil  adjustment 
issue 

Helmet  stability  critical 

Higher  cost  than  monocular 

Less  reliable  than  monocular 

3.3.6  Color  Versus  Monochrome  HMD  Trade  Study 


A  trade  study  was  performed  to  determine  whether  a  color  HMD  or  a  monochrome  HMD  would 
be  the  best  choice  for  the  STTV  system.  Table  8  shows  the  advantages  and  disadvantages  of  a 
color  versus  monochrome  approach.  When  considering  the  display  of  monochrome  sensor 
information,  the  preferred  approach  is  clearly  a  monochrome  HMD  with  the  advantages  as 
shown  in  Table  8  for  a  monochrome  approach.  When  considering  the  display  of  digital  IVIS 
type  of  Information,  a  color  display  is  preferred  for  reading  the  color  map  information. 
Considering  that  a  combination  of  both  applications  is  required,  the  preferred  approach  is  clearly 
a  color  HMD  approach.  Therefore  a  color  HMD  approach  is  recommended  for  the  STTV  HMD 
display. 
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Table  8.  Color  versus  monochrome  HMD  approach 


Color 

Monochrome 

Advantages 

Simplifies  map  reading 

Enhances  display  of  fused  imagery 

Color  coded  symbology  easier  to  inierpret 

-  Symbology  over! ay ed  on  imagery 

-  Friendly  versus  enemy  forces 
~  Emcrgcncy/critical  conditions 

Cheaper 

Less  complex  design 

Adequate  for  raw  sensor  imagery 

Disadvantages 

More  expensive 

More  complex 

Obscuration  or  loss  of  map 
information 

Obscuration  or  loss  of  symbology 
information  superimposed  on 
sensor  imagery 

3.3.7  Direct  View  Versus  See-Through  HMD  Trade  Study 

A  trade  study  was  performed  to  determine  whether  a  direct  view^'  or  a  see-through  HMD  would 
be  the  best  choice  for  the  STTV  system.  Table  9  shows  the  advantages  and  disadvantages  of  a 
direct  view  versus  see-through  HMD  approach.  When  considering  the  display  of  digital  IVIS 
type  of  information,  superposition  of  the  IVIS  information  on  the  external  world  (external  scene 
when  outside  the  vehicle  or  tank  interior  when  inside  the  vehicle)  is  not  essential.  Also, 
superposition  of  the  two  types  of  data  is  very  sensitive  to  their  relative  brightness.  When  the  two 
types  of  data  are  adjusted  for  equal  clarity,  the  intelligibility  of  the  IVIS  data  wall  be  obscured  by 
the  .see-through  data.  In  this  case  the  preferred  approach  is  a  direct  view  approach  wdth  the  direct 
view  advantages  as  shown  in  Table  9. 


Table  9.  Direct  view  versus  see-through  HMD  approach 


Direct  View  Display 

See-Through  Display 

Advantages 

Cheapest  i 

Less  dctcctihle  by  enemy 

Look-over  /  look-under  mode 

-  provides  view  of  environment 

(monocular  mode  only) 

-  less  sensitive  to  display  versus 

environment  brightness  variations 
than  see-ihrough  mode 

Provides  view  of  environment  with  a 
biocuiar  display 

Can  superimpose  symbology  onto  view^ 
of  environment 

Disadvantages 

No  view  of  environment  with  biocular 
display 

;  More  expensive 

More  easily  detectihle  by  enemy 

Causes  confusion  when  different  direct 
and  displayed  data  superimposed 

More  confusing  when  color  symbology 
superimposed  on  color  direct  view 

Relative  intensity  of  direct  versus  displayed  data 
determines  information  seen  or  missed 

-  Bright  lights  in  direct  imagery  can 

wash  out  digital  IVIS  symbology 

-  Bright  digital  IVIS  symbology  can 

wash  out  direct  imagery 
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When  considering  the  display  of  sensor  information,  the  superposition  of  the  sensor  information 
with  the  see-through  infonnation  can  lead  to  further  difficulties.  When  standing  in  the  hatch,  the 
vantage  point  of  the  sensor  may  not  be  the  same  as  the  vantage  point  of  the  commander’s  eyes, 
so  the  mis-registration  of  the  two  images  may  cause  confusion.  Also,  when  standing  in  the  hatch 
the  commander  himself  occludes  the  vision  of  the  sensor  in  some  directions,  making  the 
resulting  superimposed  images  even  more  confusing  in  that  direction.  When  inside  the  vehicle, 
the  see-through  imagery  consists  of  the  sensor  information  superimposed  on  the  interior  of  the 
vehicle.  Again,  this  superposition  is  very  sensitive  to  the  relative  brightness  of  the  two  images 
and  the  intelligibility  of  the  sensor  data  will  be  affected  by  the  see-through  data  when  the  two 
images  are  adjusted  for  equal  brightness. 

in  short,  the  use  of  an  HMD  to  display  IVIS  symbology  and  sensor  imagery  in  an  armored 
vehicle  differs  from  the  use  of  an  HMD  in  a  helicopter  application.  In  a  helicopter  application 
flight  symbology  and  fire  control  symbology  are  superimposed  on  the  external  world,  or  on  a 
FLIR  image  of  the  external  world.  This  symbology  is  much  simpler  than  the  alphanumeric  and 
map-type  symbology  of  an  IVIS  type  of  display.  It  is  also  in  a  fixed  position  on  the  display  or 
intentionally  attached  to  an  object  in  the  external  scene  (e.g.,  a  waypoint)  rather  than  randomly 
associated  with  it  as  would  be  the  case  when  viewing  IVIS  data  superimposed  on  sensor  data. 
This  makes  flight  symbology  and  fire  control  symbology  easier  to  understand.  In  an  armored 
vehicle  application  there  is  no  need  to  superimpose  IVIS  symbology  on  a  view  of  the  external 
world. 


The  armored  vehicle  situation  with  sensor  data  superimposed  on  a  see-through  view  of  the  real 
world  is  more  like  the  helicopter  situation  where  the  pilot  must  view  FLIR  imagery  (as  opposed 
to  symbology)  on  an  HMD  display  while  seeing  the  external  world  or  the  instrument  panel  in  the 
see-through  mode.  When  seeing  the  FLIR  imagery  superimposed  on  the  external  world,  the  mis- 
regi.stration  of  the  two  images  due  to  the  offset  of  the  sensor  from  the  pilot's  eyes  is  known  to  be 
confusing.  This  mis-registration  is  tolerable  only  because  the  distance  to  the  target  is  much 
larger  than  the  sensor-to-eye  separation  distance.  This  mis-registration  will  be  much  worse  for 
the  ground  vehicle  application,  where  the  distance  to  the  target  is  shorter.  In  the  case  where  the 
sensor  imagery  is  superimposed  on  the  instrument  panel,  the  helicopter  instrument  panel  displays 
are  dimmed  to  avoid  seeing  them  in  the  see-through  mode.  This  reduces  operator  confusion. 

Considering  that  it  is  not  essential  to  superimpose  IVIS  symbology  on  the  external  world  in  the 
vehicular  application,  the  preferred  HMD  approach  is  a  direct  view  display.  A  direct  view 
display  allows  the  user  to  choose  which  data  he  wishes  to  see  merely  by  looking  at  the  display  or 
by  looking  over,  under,  or  around  the  display.  Differences  in  brightness  between  the  external 
world  and  the  display  content  are  not  nearly  as  critical  in  the  direct  view  case  as  when  the  two 
are  superimposed.  A  direct  view  display  can  also  be  made  less  detectible  by  the  enemy.  For 
these  reasons,  a  direct  view  display  is  preferred  for  the  STTV  system. 

3.3.8  HMD  Display  Mounting  Configuration  Trade  Study 

Table  11  shows  several  potential  approaches  for  mounting  the  display  on  the  helmet. 
Approaches  which  mount  the  display  on  the  helmet  brow  or  on  a  Irame  worn  over  the  helmet  are 
not  compatible  with  stowing  sand,  wind,  and  dust  (SWD)  goggles  on  the  helmet,  or  with  viewing 


sensor  ports  with  padded  headrests  inside  the  vehicle.  They  also  add  protuberances  to  the  helmet 
that  can  make  it  difficult  for  a  commander  to  pass  through  a  hatch  quickly.  An  eyeglass 
mounting  approach  offers  no  on-helmet  stow  position  and  is  not  easily  stowed  when  inside  the 
vehicle.  An  integrated  goggle  approach  likewise  offers  no  on-helmet  stow  position  and  is  not 
easily  stowed  when  inside  the  vehicle.  It  is  also  incompatible  with  viewing  sensor  ports  wdth 
padded  headrests,  such  as  the  GPS  optic,  inside  the  vehicle.  A  mounting  approach  w^hich  uses  a 
stowable  arm  attached  to  the  helmet  is  compatible  with  all  these  requirements.  For  these 
reasons,  a  stowable  arm  mounting  approach  is  preferred  for  the  helmet -mounted  display. 

3.3.9  Land  Warrior  HMD  Compatibility  Trade  Study 

It  is  desirable  for  the  Army  to  have  an  STTV  HMD  that  is  compatible  with  the  Army’s 
dismounted  Land  Warrior  day  display  (Figure  15).  Benefits  include  interoperability,  improved 
design  for  reliability,  and  lower  life  cycle  cost  due  to  the  sharing  of  logistics  ser\dces.  There  are 
several  ways  that  an  STTV  HMD  can  be  made  compatible  with  the  Land  Warrior  day  display. 
These  are  shown  in  Table  10. 


Figure  15.  Honeywell  Land  Warrior  day  display 


Table  10.  Land  Warrior  compatibility  options 


Option 

Drive 

Eleci- 

ronics 

Control 

Panel 

Helmet 

Cable 

Flat 

Panel 

Optics  : 

Helmet 

Mount 

Compatible  with 

IflU 

cve 

helmet 

640x480 

IVLS 

f'gcn 

CITY 

S(X)xMX) 

FBCB2 

2”^  gen 
CITY 

1 

LW 

LW 

LW 

mmm 

LW 

LW 

No 

Yes 

No 

No 

No 

2 

LW 

LW 

LW 

LW 

LW 

New 

Ye,s 

Yes 

No 

No 

No 

3 

New 

New 

LW 

LW 

New 

ye.s 

Yes 

No 

4 

New . 

New 

LW 

New 

Yess 

Yes 

'Yes 

No 

No 

5 

'  New 

LW 

New  ■ 

MM 

Yes  . 
4:3  output 

6 

iSi 

H 

New 

Yes 

Yes 

YYes'L 
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Table  10  shows  that  the  current  Honeywell  Land  Warrior  display  (Option  1)  is  compatible  only 
with  the  640x480  pixel  IVIS  display  found  on  the  M1A2  tank  To  make  it  compatible  with  the 
CVC  helmet  used  on  an  armored  vehicle  requires  changing  the  helmet  mount  (Option  2).  To 
make  it  compatible  with  the  first  generation  FLIR  CITV  used  on  the  M1A2  tank  requires  the 
electronics  to  be  compatible  with  the  RS-330  standard,  which  requires  a  new  electronics  design 
and  also  a  new  control  panel  (Option  3).  Adding  a  640x480  color  flat  panel  display  with 
matching  electronics  and  cables  (Option  4)  does  nothing  to  increase  the  compatibility  over  a 
640x480  design.  To  make  the  Honeywell  Land  Warrior  display  compatible  with  the  new 
800x600  pixel  color  FBCB2  Applique+  display  requires  a  new  800x600  color  flat  panel  display, 
which  also  requires  new  drive  electronics,  a  new  control  panel,  and  a  new  helmet  cable  (Option 
5).  This  will  also  make  it  compatible  with  the  new  second  generation  FLIR  CITV  if  the  4:3 
aspect  ratio  RS-170  output  is  used.  A  new  1280x1024  pixel  color  flat  panel  display  with  new 
drive  electronics,  a  new  control  panel,  and  a  new  helmet  cable  (Option  6),  will  make  it 
compatible  with  both  the  800x6(K)  pixel  color  FBCB2  Applique+  display  and  the  new  second 
generation  FLIR  CITV  with  16:9  aspect  ratio  RS-ITO  output.  Since  nearly  all  armored  vehicles 
of  the  future  will  have  the  FBCB2  Applique+  digital  display,  which  is  800x600  color,  and  the 
HTI  second  generation  FLIR  sensor,  which  has  1316x480  pixels.  Option  5  is  the  preferred 
approach  for  meeting  the  SITV  requirements. 

In  January  2000  after  this  trade  study  was  completed,  the  Land  Warrior  day  display  was  changed 
to  an  8(X)x6(K)  pixel  color  display  wdth  a  40®  field  of  view  (Option  5).  Therefore,  only  a  new 
helmet  mount  and  control  panel  are  required  to  make  this  new  Land  Warrior  display  compatible 
wdth  STTV  requirements. 

3.3.10  Head  Tracker  Trade  Study 

A  head  tracker  is  required  to  select  the  field  of  view  to  be  displayed  in  the  STTV  helmet- 
mounted  display.  During  the  Phase  1  effort  a  tradeoff  study  was  performed  to  select  the  best 
head  tracker  for  the  STTV  requirement.  Candidate  trackers  included  Honeywell’s  Advanced 
Metal  Tolerant  Tracker  (AMTT)  and  the  commercially  available  IS-300  tracker  from  InterSense 
Inc  (Figure  1 6). 


Figure  16,  InterSense  IS-300  head  tracker 


The  InterSense  IS-300  tracker  consists  of  two  .sensing  cubes  connected  via  ten  foot  long  cables  to 
a  signal  processor.  Each  sensing  cube  contains  three  angular  rate  sensors  (MEMS  tuning  fork 
gyros),  three  accelerometers,  and  three  magnetometers.  The  signal  processor  integrates  the 


outputs  of  the  accelerometers  to  get  the  position  changes  of  each  sensor  cube  along  an  axis  in 
inertial  space.  Since  the  angular  rate  sensors  drift  over  time,  a  correction  is  applied  to  the  gjnro 
outputs  whenever  they  are  at  re.st  to  compensate  for  the  drift.  The  compensation  is  determined 
by  the  change  in  orientation  of  the  magnetometers  with  respect  to  the  earth’s  magnetic  field.  The 
processed  output  from  one  sensor,  therefore,  yields  the  change  in  orientation  of  the  sensor 
relative  to  the  earth’s  gravitational  and  magnetic  fields.  When  used  as  a  head  tracker  on  a 
moving  vehicle,  one  sensing  cube  is  attached  to  the  turret  of  the  tank  and  the  other  to  the  tank 
commander’s  helmet.  The  difference  in  output  between  the  two  sensing  cubes  indicates  the 
relative  orientation  of  the  commander’s  helmet  with  respect  to  the  turret  position. 

The  lS-300  sensor  was  first  tested  for  accuracy  in  a  uniform  static  magnetic  field  in  the 
laboratory.  It  was  found  to  be  repeatable  to  ±  3  degrees.  It  was  then  tested  in  a  moving  vehicle. 
One  sensor  was  held  stationary  to  the  vehicle  (near  the  transmission  dome)  while  the  other 
sensor  w'as  moved  back  and  forth  by  hand  (at  shoulder  height)  to  simulate  side-to-side  head 
motion.  The  vehicle  was  driven  in  a  15  meter  diameter  circle.  Data  collection  started  at  the 
beginning  of  vehicle  motion  and  stopped  when  the  vehicle  had  completed  the  circle.  The  results 
are  shown  in  Figure  17.  The  results  show  that  the  hand-held  sensor  unit  behaved  about  as 
expected,  with  an  ©.scillatory  motion  superimpo.sed  on  a  slower  variation  from  0°  to  360*. 
Angles  from  0°  to  180°  have  a  different  sign  than  angles  from  180°  to  360°  (i.e.,  -180°  to  0°). 
The  vehicle-fixed  sensor  did  not  behave  as  expected.  It  should  have  followed  a  path  similar  to 
that  of  the  hand-held  unit,  but  without  the  oscillation.  However,  it  only  indicated  a  motion  from 
0°  to  100°  and  back  to  0°  again.  This  is  believed  to  be  the  result  of  gyro  drift  caused  by  a  lack  of 
re -calibration  due  to  the  lact  that  the  vehicle  sensor  is  continuously  moving.  The  hand-held 
sensor,  on  the  other  hand,  gets  re-calibrated  because  it  is  momentarily  at  rest  while  its  direction 
of  oscillation  is  changing.  When  both  sensors  are  tied  together  in  the  laboratory,  they  have 
similar  outputs  as  they  are  rotated  through  360°  because  they  both  get  re-calibrated  while  they 
are  stationary  as  each  measurement  is  taken. 


Figure  17.  Evaluation  results  from  IS-300  head  tracker  on  a  moving  vehicle 

These  results  lead  to  the  conclusion  that  the  InterSense  tracker  works  adequately  in  a  laboratory 
environment  having  stable  and  uniform  magnetic  fields,  and  when  the  required  accuracy  is  no 


29 


better  than  a  few  degrees.  However,  it  requires  improvement  before  being  used  on  a  moving 
vehicle  or  on  a  vehicle  that  produces  significant  magnetic  distortion. 

The  Honeywell  AMTT  tracker  was  tested  on  an  Ml  13  armored  vehicle  at  the  Minneapolis 
National  Guard  armory  on  28  January  99  (Figure  IS).  The  AMTT  transmitter  was  installed 
inside  the  MI  13  passenger  compartment  approximately  six  inches  below  the  roof,  ten  inches  to 
the  right  of  the  vehicle  centerline,  and  14  inches  behind  the  center  of  the  commander’s  hatch. 
The  -AMTT  receiver  was  mounted  on  a  computerized  mapping  fixture  that  w'as  translated 
throughout  the  volume  of  the  commander’s  head  motion  box.  The  turret  hatch  was  closed  during 
the  test.  The  overall  results  over  a  large  head  motion  box  (22”x24”x  1 0”)  were  as  shown  in  Table 
12. 


Figure  18.  Testing  the  AMTT  tracker  on  an  Ml  13 


Table  1 2.  Evaluation  results  for  AMTT  tracker  on  an  Ml  13 


■Angle  Error  in  Degrees 

Translation  Error  in  Inches 

Azimuth 

0.42 

X  (Fore/Aft)  0.04 

Elevation 

0.11 

Y  (Lateral)  0.07 

Roll 

0.36 

Z  (Vertical)  0.02 

Tiiese  results  confirm  that  the  AMTT  tracker  can  be  used  for  head  tracking  in  armored  tracked 
vehicles  and  is  preferred  over  the  InterSen.se  tracker  for  accuracy  purposes.  However,  the 
InicrSense  trticker  is  preferred  for  laboratory'  demonstrations  because  of  its  lower  cost. 

3.3.1 1  Demonstration  Vehicle  Trade  Study 

•A.  trade  study  w'as  performed  to  select  an  armored  vehicle  for  the  STTV  system  demonstration. 
Candidate  vehicles  were  an  Abrams  M1A2  (Figure  19),  a  Bradley  M2A2/.A3  (Figure  20),  and  an 
Ml  13  .Armored  Pensonne!  Carrier  (Figure  21).  The  Abrams  M1A2  was  preferred  because  of  its 
perceived  need  for  a  helmet-mounted  display  and  its  prior  use  in  other  helmet -mounted  display 
studies.  However,  Ml  A2’s  are  available  only  from  the  U.  S.  Army  Armor  Center  at  Fon  Knox, 
and  are  in  heavy  demand  for  training  purposes  due  to  their  limited  numbers.  Therefore, 
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discussions  with  U.  S.  Army  Armor  Center  representatives  indicated  that  the  likelihood  of 
getting  an  M1A2  for  two  or  three  days  for  an  STTV  system  demonstration  would  be  nearly 
impossible.  Similar  discussions  were  held  for  tlie  Bradley  M2A2/A3,  and  similar  conclusions 
were  reached.  Therefore,  an  Ml  13  Armored  Personnel  Carrier  was  selected  as  the 
demonstration  vehicle  because  it  could  be  obtained  from  two  sources;  the  Minnesota  National 
Guard  at  New  Brighton,  MN,  and  the  U.S.  Army’s  Night  Vision  and  Electronic  Sensors 
Directorate  (NVESD)  at  Picatinny  Arsenal,  NJ. 


Figure  19.  Abrams  Ml  A2  Figure  20.  Bradley  M2  A3  Figure  21.  Gavin  Ml  13 

3.3.12  Vehicle  Interface  Trade  Study 

STTV  sensor  location  on  the  M1A2  tank.  A  trade  study  was  performed  to  determine  the 
optimum  location  for  the  STTV  sensor  on  an  M1A2  lank.  Since  the  M1A2  tank  already  has  a 
first  generation  FLIR  CITV  sensor  (soon  to  be  upgraded  to  an  HTl  second  generation  FLIR 
sensor),  only  the  panoramic  camera  portion  of  the  hybrid  STTV  .sensor  needs  to  be  located.  All 
of  these  locations  must  lie  on  the  tank’s  turret  or  else  it  is  necessciry  to  pass  the  video  signals 
through  the  tank’s  slip  rings.  This  would  require  a  major  redesign  of  the  slip  ring  assembly. 

Figure  22  shows  the  three  panoramic  sensor  locations  considered.  The  locations  are:  1 )  on  the 
commander’s  hatch  cover,  2)  over  the  CITV  sensor,  and  3)  on  the  turret  bustle.  Locating  it  on 
the  commander’s  hatch  cover  (option  I)  provides  the  best  vantage  point  with  the  least  occlusion 
and  the  least  offset  from  the  commander’s  normal  viewing  point,  but  raises  obvious  safety  is.sues 
with  the  additional  force  required  to  open  the  hatch.  Locating  it  on  the  turret  bustle  (option  3) 
provides  a  more  protected  mounting  point  with  non-occluded  viewing  positions.  Locating  it  over 
the  CITV  sensor  (option  2)  has  the  advantage  of  keeping  the  same  origin  for  the  panoramic 
camera  and  the  CITV  sensor,  and  provides  a  good  vantage  point  with  minimal  occlusion.  The 
CITV  sensor,  likewise,  is  not  occluded  by  the  STTV  sensor  or  its  mount  because  the  STTV 
sensor  can  be  mounted  on  the  existing  cover  plate  that  protects  the  CITV  sensor  in  its  stow 
position.  Therefore,  the  preferred  sensor  location  on  the  M1A2  tank  is  over  the  CITV  sensor  as 
shown  in  option  2. 

STTV  controls  location  on  the  M1A2  tank.  It  is  essential  to  have  the  STTV  HMD  controls 
accessible  to  the  commander  while  he  is  standing  in  the  hatch.  Discussions  with  Army  users 
emphasized  that  placing  the  controls  anywhere  on  the  commander’s  clothing  was  unacceptable 
due  to  the  cumbersome  nature  of  the  items  already  being  worn  by  the  commander  (fire  retardent 
suit,  outer  garment,  NBC  mask  with  connections,  intercom  with  connections,  etc.).  Figure  23 
shows  the  possible  control  panel  locations  considered.  One  position  was  outside  the  hatch  but 
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Figure  23.  Candidate  control  panel  iocation.s  on  an  Ml  A2  tank 

Sensor  location  on  the  M113  Armored  Personnel  Carrier  (APC).  A  trade  study  was 
performed  to  determine  the  optimum  location  for  the  STTV  sensor  on  the  Ml  13  APC.  One 
location  considered  was  on  top  of  the  vehicle  over  the  cover  plate  to  the  right  and  rear  of  the 
commander's  turret  (Figure  24  (c)  (1)).  This  would  allow  bringing  the  cables  into  the  interior 
through  an  existing  hole  in  the  vehicle.  Also,  the  existing  bolt  holes  currently  used  by  the  cover 
plate  could  be  used  to  mount  the  sensor  to  the  vehicle.  However,  this  position  would  result  in  an 
offset  in  the  sensor’s  vantage  point  from  the  commander’s  seated  head  position,  which  can  cause 
problems  in  the  use  of  the  sensor.  Another  location  considered  was  on  top  of  the  rectangular 


ventilation  hatch  centered  in  back  of  the  commander’s  hatch  (Figure  24  (b)  (2))  and  Figure  24  (c) 
(2)).  This  location  causes  no  offset  in  vantage  point  for  the  commander  and  is  easily  adapted  to 
sensor  mounting.  Considering  that  the  M  l  13  is  being  used  solely  as  a  demonstration  vehicle,  the 
simplest  sensor  mounting  scheme  is  to  lock  the  rectangular  hatch  in  its  fully  open  position  and  to 
position  the  STTV  sensor  on  a  custom  mounting  platform  that  fits  into  the  hatch  opening.  This 
automatically  provides  a  means  of  bringing  the  cables  into  the  vehicle,  and  allows  rapid  setup  for 
demon.stration.  No  modification  of  the  vehicle  is  required. 


Figure  24.  Candidate  sensor  locations  on  an  M 1 1 3 

3.4  Prototype  System  Development  Specification 

A  prototype  system  development  specification  was  written  that  describes  how  the  components 
selected  in  the  trade  studies  can  be  integrated  into  a  coherent  system  capable  of  meeting  the 
established  requirements.  This  specification  is  included  in  Appendix  2  of  this  report.  The 
specification  defines  the  sy.stem  shown  in  Figure  25.  It  consists  of  a  panoramic  sensor  unit 
containing  both  a  staring  sensor  and  a  gimbaled  sensor;  an  image  processor;  a  helmet-mounted 
display  with  display  control  module;  a  helmet  with  display  mount;  a  commander’s  control  panel; 
a  head  tracker;  a  developer’s  control  panel  with  joystick,  an  RS-232  switch,  and  a  power  supply. 
The  vehicle  commander  can  view  on  his  helmet-mounted  display  either  the  panoramic  seasor 
data  or  the  FBCB2  situation  awareness  data.  Panning  of  the  sensor  field  of  view  is  done 
automatically  by  the  head  tracker  in  response  to  the  commander’s  head  motion. 


Figure  25.  Prototype  system  block  diagram 
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The  commander  can  control  the  display  brightness,  contrast,  and  data  selection  via  controls 
attached  to  his  uniform,  making  it  convenient  to  access  these  controls  while  he  is  either  inside 
the  vehicle  or  standing  in  the  hatch.  Sensor  controls  for  display  polarity,  zoom,  tracking  reticle, 
and  head  tracker  calibration  are  located  on  the  commander’s  control  panel  that  can  be  placed  just 
inside  the  hatch,  making  it  convenient  to  access  these  controls  while  inside  the  vehicle. 
Provision  is  made  for  an  optional  squad  leader’s  display  with  joystick  to  allow  a  squad  leader  in 
the  vehicle’s  passenger  compartment  to  see  the  FBCB2  situation  awareness  data  or  to  pan  the 
sensor  imagery  directly  before  exiting  the  vehicle. 

Performance  capabilities  of  the  prototype  system  are  shown  in  Figure  26.  These  capabilities  do 
not  completely  satisfy  the  system  requirements  shown  in  Figure  10  because  program  funding 
available  in  the  program  for  system  development  was  insufficient  for  developing  entirely  new 
performance-critical  components  such  as  panoramic  infrared  sensors  and  color  helmet-mounted 
displays.  Therefore,  system  development  was  limited  to  the  use  of  commercially  available 
sensors  and  the  existing  monochrome  Land  Watrior  display.  Similarly,  the  program  funding  was 
insufficient  to  perform  vehicle  integration  tasks  necessary  to  demonstrate  the  system  on  a 
moving  armored  vehicle.  However,  the  prototype  system  defined  in  the  development 
specification  is  capable  of  demonstrating  the  essential  features  of  the  required  situation 
awareness  visualization  system  in  a  laboratory  or  on  a  stationary  armored  vehicle.  With  minimal 
additional  funding  the  system  can  be  improved  and  integrated  into  a  moving  armored  vehicle. 
Later,  if  field  testing  confirms  the  effectiveness  of  the  prototype  system  concept,  then  further 
improvements  can  be  made  in  sensor  design,  display  design,  tracker  selection,  and  vehicle 
integrcition. 


Sensor  Performance 

•  360”  field  of  regard 

•  26”xirFOV  " 

•  in  focus  >15  feet 

•  0.55  um  wavelength 

•  daytime  operation  only 

•  >1507sec  slew  rate 


Display  Performance 

•  monocular 

•  non  .see-through 

•  640x480  pixels 

•  267x19”  FOV 

•  monochrome 


System  Performance 

•  able  to  detect  human  at  400  yards 

•  <66  msec  sytem  latency 

•  .slew  to  cue  capability 


Figure  26.  Prototype  system  capabilities 

3.5  Prototype  System  Description 


The  following  subsections  describe  the  prototype  system  developed  during  the  program. 
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3.5.1,  360°  Panoramic  Sensor 


The  360°  panoramic  sensor  (Figure  27)  consists  of  eight  659x494  pixel  visible  charge-coupled 
device  (CCD)  cameras  with  each  camera  having  a  6  mm  auto  iris  lens  with  a  field  of  view  of 
56°(H)x42°(V).  The  cameras  point  upward  into  eight  planar  mirrors  tilted  outward  to  provide  a 
horizontal  field  of  view  of  360°  and  a  vertical  field  of  view  of  42°.  The  vertical  field  of  view  is 
tilted  downward  1°  from  the  horizontal  to  place  2/3  of  the  vertical  field  of  view  below  the 
horizon.  The  mirror  arrangement  allows  the  camera-to-mirror  distance  to  be  adjusted  so  that  the 
cameras  can  be  brought  to  a  common  virtual  focal  point,  eliminating  any  parallax  between  the 
cameras.  This  assures  that  any  objects  in  between  two  cameras  are  not  doubly  imaged  or 
omitted,  which  can  occur  if  camera  vergence  is  not  changed  with  distance  as  it  is  with  human 
eyes.  Actually,  the  camera-to-mirror  distance  is  adju.sted  so  that  adjacent  cameras  have  slightly 
overlapping  horizontal  fields  of  view  to  simplify  the  blending  at  image  borders.  This  leaves  a 
residual  parallax  due  to  a  virtual  camera  separation  of  about  *4  to  Vz  inch,  which  is  imperceptible 
at  ranges  beyond  about  15  feet.  A  processor  is  then  used  to  blend  adjacent  images  into  a 
combined  intermediate  camera  view,  enabling  continuous  panning  through  360°  as  though  one  is 
looking  at  a  single  360°  panoramic  image. 


Figure  27.  STTV  panoramic  image  sensor 

.Another  important  sensor  feature  is  that  motion  blur  caused  by  image  offset  between  two  fields 
of  the  same  frame  is  completely  eliminated  by  selecting  CCD  cameras  that  have  all  the  pixels  in 
both  fields  illuminated  within  the  same  1/60  second  integration  time.  The  tw'o  fields  are  then 
read  out  simultaneously  into  digital  .scan  converters'"  that  provide  a  standard  field  sequential  RS- 
170  output.  Additionally,  the  cameras  have  automatic  gain  control  circuits  and  auto  iris  len.ses 
that  enable  operation  over  a  range  of  ambient  illumination  from  0.8  lux  to  3x10*^  lux  at  f/L4 
(moonlit  night  to  bright  sunlight).  The  cameras  also  have  an  RS-232  interface  that  allows  the 
processor  to  change  the  camera  integration  time  and  gain  settings  in  real  time. 


The  complete  panoramic  sensor  is  14  inches  in  diameter  by  23  inches  high,  which  allows  it  to  be 
placed  on  top  of  an  armored  vehicle  and  still  see  the  ground  15  feet  aw'ay.  Alternatively,  only 
the  13  inch  high  camera  portion  can  be  located  outside  the  vehicle  with  the  10  inch  high 


electronics  portion  placed  inside.  The  sensor  has  a  transparent  acrylic  window  to  keep  out  dust 
and  moisture. 

3.5.2.  Gimbaled  Infrared  Sensor 

The  gimbaled  infrared  (IR)  sensor  (Figure  28)  is  a  commercially  available  unit  developed  by 
Nytech  Inc.  for  the  United  States  Army.  It  consists  of  a  320x240  pixel  8-12  pm  microbolometer 
sensor  with  a  75  mm  focal  length  lens  that  provides  a  field  of  view  of  15.5°(H)xl  L5°(V).  The 
sensor  has  an  RS-170  video  output  and  an  NETD  of  less  than  0.1  OOK.  It  is  gimbal-mounted  so 
that  can  be  slewed  in  both  the  azimuth  and  elevation  directions  at  rates  approaching  200®  per 
second  and  accelerations  approaching  600°/sec“,  The  azimuth  gimbal  is  capable  of  continuous 
rotation.  Its  absolute  pointing  accuracy  is  one  part  in  4096,  or  5  minutes  of  accuracy.  The  unit 
accepts  position  and  velocity  commands  via  an  RS-232  interface  and  provides  feedback  of  its 
intermediate  gimbal  positions  while  slewing.  The  complete  unit  is  14  inches  high  and  10  inches 
in  diameter.  It  dissipates  20  watts  at  idle  and  up  to  200  watts  at  maximum  acceleration.  In  the 
STTV  system  this  sensor  is  used  to  simulate  the  commander’s  forward-looking  infrared  (FLIR) 
.sensor  found  on  many  armored  vehicles,  such  as  the  CITV  on  the  M1A2  Abrams  or  the 
Commander’s  Independent  Viewer  (CIV)  on  the  M2A3  Bradley.  If  the  vehicle  already  has  a 
commander’s  FLIR  onboard,  this  sensor  can  be  omitted.  Otherwise,  it  provides  a  low  cost 
alternative  to  a  high  performance  FLIR  sensor. 


Figure  28.  STTV  gimbaled  infrared  sensor 

The  gimbaled  infrared  sensor  can  be  mounted  atop  the  360”  panoramic  sensor  to  provide  a 
merged  sensor  (Figure  29).  The  sensors  can  be  used  either  singly  or  together  in  a  fused  mode  as 
show'n  in  Figure  30.  When  viewed  on  a  helmet-mounted  di.splay,  only  a  portion  of  the  360®  field 
of  view  is  displayed  at  one  time.  This  portion  is  adjusted  to  be  equal  to  the  angular  sub-tense  of 
the  display  in  tront  of  the  eye  in  order  to  make  the  scale  factor  of  the  displayed  image  equal  to 
that  of  the  real  world.  This  makes  the  panning  rate  of  the  imagery  in  the  display  equal  to  the  rate 
of  head  motion,  which  minimizes  user  discomfort.  An  electronic  zoom  capability  is  also 
provided. 

3.5.3.  Helmet-Mounted  Display  with  Head  Tracker 

The  prototype  STTV  helmet-mounted  display  (Figure  31)  is  a  640x480  pixel  monochrome 
.Active  .Matrix  Electro  Luminescent  (AMEL)  display  with  a  field  of  view  of  26*(H)x19°(V).  It  is 
mounted  on  a  standard  Combat  Vehicle  Crew  (CVC)  helmet  in  a  way  that  allows  convenient 
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viewing  while  minimizing  interference  when  moving  through  the  hatch  or  using  an  optical  sight. 
The  display  mount  has 


Figure  29.  Combined  panoramic  and  gimbaled  IR  sensors 


360'^  Panoramic  Sensor  Unit 

360^^x42"  FOV  (26^x19"  sub  FOV  displayed) 
Visible  CCD  (ICCD  or  tWIR  possible*} 

Electronic  pan,  tilt,  zoom  - 

Multiple  simultaneous  users* 

Provides  low  latency  view  ol  surroundings 

’  Future  ootion 


Gimbaled  Infrared  Sensor  Unit 

iS^S^xli.S^'  field  of  view 
3-12  micron  Infrared  sensor 
320x240  pixels  ftow 
340x480  pixels  In  future 
Mechartically  scanned  gimbal 
Provides  high  resolution  detail 

i 


Figure  30.  Operation  and  display  of  the  combined  STTV  sensors 

four  detent  positions:  1)  a  viewing  position  directly  in  front  of  the  eye,  2)  a  viewing  position 
seven  degrees  below  the  line  of  sight  that  allows  looking  over  the  display,  3)  a  stow  position 
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beside  the  user’s  chin,  and  4)  a  stow  position  behind  the  user’s  right  ear.  The  mount  allows 
adjustment  of  the  display-to-eye  distance,  the  inter-pupillary  distance,  and  the  horizontal  detent 
position.  The  display  has  brightness  and  contrast  controls  and  can  be  switched  to  display  either 
STTV  video  or  FBCB2  situation  data.  The  same  helmet  mount  can  accommodate  an  800x6(X) 
color  display  that  provides  improved  intelligibility  of  the  FBC-B2  data. 


Figure  31.  STTV  helmet-mounted  display 

The  prototype  STTV  head  tracker  is  a  commercially  available  IS-300  head  tracker  made  by 
InterSensc  Inc  (Figure  32).  It  has  an  angular  accuracy  of  1°  to  3°  RMS  and  an  update  rate  of  150 
Hz.  Its  1. lx  1.2x1. 3  inch  inertial  measurement  unit  is  attached  atop  the  CVC  helmet  and  provides 
three  degrees  of  freedom  via  an  RS-232  data  link.  The  inertial  measurement  unit  uses 
inexpensive  angular  rate  gyros  that  provide  acceptable  performance  in  a  laboratory  environment. 
However,  the  update  technique  used  to  correct  for  gyro,  drift,  based  on  sensing  the  earth’s 
gravitational  and  magnetic  fields  during  period.s  of  head  motion  inactivity,  is  not  intended  for  u.se 
on  a  moving  armored  vehicle.  When  operation  on  a  moving  armored  vehicle  is  desired, 
Honcyw'elFs  metal-tolerant  magnetic  tracker  can  be  used.  This  tracker  has  been  tested  on  an 
Ml  13  armored  personnel  carrier,  and  has  been  confirmed  to  operate  with  the  accuracy  needed  by 
the  STTV  display  system. 


Figure  32.  InterSense  IS-300  head  tracker 


3.5.4.  Image  Processor 

The  STTV  image  prcKessor  (Figure  33)  is  a  PVT-200  processor  developed  by  the  Samoff 
Corporation  under  previous  DARPA  contracts.  It  is  sold  commercially  by  Pyramid  Vision 
Technologies.  It  consists  of  an  8-slot  6Uxl6()  subrack  in  a  14x19x1 1  inch  enclo,sure.  The  eight 
slots  arc  populated  with  a  processor  motherboard  (two  slots)  and  six  video  processor 
motherboards.  The  processor  motherboard  contains  two  C40  digital  signal  processors  (DSP’s) 
and  two  daughter  boards,  with  each  daughter  board  providing  another  C40  DSP.  All  four  DSP’s 
have  .Mbytes  of  fast  static  Random  Access  Memoiw  (RAM)  each.  Each  video  processor 
motherboard  contains  four  2  Mbyte  and  one  16  Mbyte  simultaneous  read/write  frame  store 
memories,  four  pyramid  processors,  and  two  reconfigurable  processing  elements,  plus  tw'o  video 
processor  daughter  boards.  Each  video  processor  daughter  board  performs  a  special-purpose 
\idco  processing  function  such  as  warping,  correlation,  digitization  of  analog  video,  or 
displaying  digital  output  in  an  analog  foimat.  The  arrangement  of  video  processor  daughter 
boards  is  reconfigurable,  and  in  the  case  of  the  STTV  system  consists  of  three  digitizer  boards 
tor  nine  videci  channels,  six  warper  boards  for  image  transformations,  one  correlator  board  for 
tiiree  clianncls  of  image  correlation,  and  two  display  boards.  Video  processing  is  accomplished 
b\  pipelming  an  image  from  a  video  frame  store  or  DSP  memory,  routing  it  through  one  or  more 
recordlgurahie  processing  elements,  daughter  boards,  or  DSP’s,  and  writing  it  back  into  a  video 
st('re  DSP.  Multiple  video  frames  are  processed  simultaneously  using  high  bandwhdth 
rrogranuT'.abie  interconnections  between  the  video  memories  and  processing  elements.  Each 
:;..';::erb.',;rd  has  ;;  crosspoint  switch  with  a  1.2  Gbyte.s/sec  bandwidth  that  routes  its  eight  video 
rm,::  bosvcs  :.'3  Mhyies/sec  each)  to  its  various  onboard  processing  elements  and  then  routes 
rc'clts  to  its  eight  video  output  busses.  The  motherboards,  in  turn,  communicate  with  each 
, ,.  second  erosspoint  switch  of  1.8  Gbytes/sec  bandwidth  that  comprises  the  global 
"-iCK:'.,::'.e  bus.  This  architecture  allows  multiple  frames  of  video  to  be  processed  concurrently, 
\;e;,;;r-.g  .in  ecu:\aicnt  processor  throughput  of  50  Giga-operations  per  second.  The  processor 
n.is  nine  RS-;-!)  composite  analog  inputs,  tw'o  RS-I70  composite  analog  outputs,  and  four  RS- 

con::,';  n.'r.s. 


Figure  33.  STTV  image  processor 

The  PVT-20()  processor  performs  all  of  the  image  processing  and  control  functions  in  the  STTV 
system.  It  digitizes  the  outputs  of  the  eight  panoramic  sensor  cameras,  selecting  the  one  or  two 
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video  data  streams  that  contain  the  commander’s  current  field  of  view,  and  warping  the  images 
to  correct  for  lens  distortion.  The  processor  then  warps  the  adjacent  images  again  in  real  time  to 
synthesize  two  new  sub-images  in  the  correct  line  of  sight  direction,  stitching  them  together  and 
blending  them  to  make  a  continuous  image  without  any  noticeable  joints  or  seams.  In  the 
meantime,  it  slews  the  IR  sensor  to  the  same  line  of  sight  position  and  digitizes  the  IR  camera 
output,  displaying  it  either  separately  or  fused  with  the  visible  sensor  data.  Electronic  zoom  is 
also  applied.  Finally,  a  moving  object  tracker  is  provided  that  enables  the  visible  and  IR  sensors 
to  remain  locked  onto  a  designated  target  while  the  vehicle  and  the  user’s  head  undergo  arbitrary 
motion.  Image  stabilization  can  also  be  provided  electronically  via  the  PVT-200.  The 
algorithms  for  these  functions  were  adapted  from  algorithms  developed  by  the  Sarnoff 
Corporation  under  previous  DARPA  contracts. 

3.5.5.  Commander’s  Control  Panel 

The  STTV  system  is  controlled  via  the  commander’s  control  panel  shown  in  Figure  34.  The 
commander  can  choose  to  display  the  visible  panoramic  sensor  only,  the  gimbaled  IR  sensor 
only,  or  both  sensors  together  in  a  fused  mode.  A  fourth  selection  enables  the  di.splay  of  a 
second-generation  FLIR  sensor  with  appropriate  warping  of  the  imagery  to  show  it  on  a  display 
having  square  pixels.  The  IR  imagery  or  FLIR  imagery  can  be  viewed  as  either  white  hot  or 
black  hot  to  allow  for  thermal  inversion  depending  on  the  time  of  day.  Viewing  is  done  in 
response  to  the  user’s  head  orientation,  which  can  pan  through  a  full  360'*  of  azimuth,  180°  of 
azimuth,  and  360°  of  head  roll.  By  holding  down  the  HMD  VIEW  toggle  switch,  the  user  can 


Figure  34.  Commander's  control  panel 


see  a  rear  view  180°  in  back  of  his  head  while  avoiding  the  need  to  turn  his  head  180°.  When 
viewing  imagery,  the  user  can  zoom  either  in  or  out  or  can  make  the  size  of  the  target  reticle 
larger  or  smaller.  These  functions  allow  one  to  select  an  object  in  the  current  field  of  view,  which 
can  then  be  tracked  by  pressing  the  DESIGNATE  &  TRACK  TARGET  pushbutton.  While  the 
selected  object  is  being  tracked  in  a  special  tracking  window  by  the  visible  and  IR  sensors,  the 
user  can  continue  to  pan  the  visible  panoramic  sensor  in  an  arbitrary  direction  in  the  original 
window.  As  the  target  object  slides  off  the  edge  of  the  field  of  view,  an  indicator  arrow  appears 
to  show  the  user  in  which  direction  he  should  turn  his  head  to  re-acquire  the  tracked  object.  The 
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user  can  view  the  target  in  the  tracking  window  at  any  time  by  depressing  the  VIEW  TARGET 
pushbutton.  This  function  simulates  the  slew-to-cue  function  found  on  the  M 1 A2  Abrams  and 
the  M2A3  Bradley.  W'hile  pressing  the  VIEW  TARGET  pushbutton  the  user  can  re-center  the 
tracking  window  on  a  smaller  sub-object  in  the  tracked  object  and  then  select  that  sub-object  by 
using  the  DISPLAY  ZOOM,  RETICLE  SIZE,  and  AIMPOINT  ADJUST  switches.  Pressing  the 
DESIGNATE  &  TRACK  TARGET  pushbutton  a  second  time  then  causes  only  the  smaller  sub¬ 
object  to  be  tracked.  Releasing  the  VIEW  TARGET  pushbutton  returns  the  display  to  the 
original  window  in  the  direction  indicated  by  the  user’s  head  position,  but  with  the  target  still 
being  tracked  in  the  unseen  tracking  window.  When  the  user  wishes  to  exit  the  target  tracking 
mode  he  depresses  the  TRACK  HELMET  pushbutton,  which  returns  control  of  the  visible  and 
IR  sensors  to  the  head  tracker  in  the  current  head  position.  The  remaining  ALIGN  FWD 
DIRECTION  switch  is  used  to  align  the  head  tracker  to  the  forw-ard-facing  .sensor  direction, 
defined  to  be  the  front  of  the  vehicle's  turret.  The  user  depresses  this  pushbutton  while  pointing 
his  head  forward  in  the  turret  as  indicated  by  aligning  a  crosshair  on  the  display  with  a  mark  on 
the  turret’s  front  wall.  Alignment  only  needs  to  be  performed  once  on  system  power-up.  A 
complete  description  of  the  control  panel  functions  is  provided  in  Table  13. 

3.5.6,  System  Block  Diagram 

A  block  diagram  of  the  complete  STTV  system  is  shown  in  Figure  35.  Figure  36  show's  a 
photograph  of  the  complete  system. 


Figure  35.  STTV  system  block  diagram 


The  PVT-2(K)  processor  accepts  imagery  from  the  visible  and  IR  .sensors  and  generates  RS-170 
outputs  for  the  vehicle  commander’s  helmet-mounted  display  and  an  optional  squad  leader’s 
helmet-mounted  display.  The  commander  controls  both  the  visible  and  IR  sensors  via  the 
commanders  control  panel  and  pans  through  the  selected  imagery  using  his  on-helmei  tracker. 
In  a  future  option,  the  squad  leader  will  have  access  to  the  imagery  from  the  visible  panoramic 
sensor,  wdih  a  vehicle-mounted  joystick  for  panning.  The  squad  leader  w'ill  then  be  able  to  pan 
and  view  the  visible  panoramic  sensor  in  any  direction  independently  of  the  vehicle  commander 
while  the  vehicle  commander  is  using  the  same  sensor  for  other  purposes.  Both  the  vehicle 
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commander  and  the  squad  leader  will  have  access  to  the  FBCB2  tactical  situation  data  on  their 
helmet-mounted  displays. 

Table  13.  Commander’s  control  panel  functions 


V'nv'r  Vkvt 

•  Vjsmit*  v'UMn  •’'n'y 

•  IK  vovif  oruv 

•  \  tMh'.e  and  IK  vn,\orN  “luscd" 


Rotary  switch  (with  4  dcten 


I 


Visible  Sensor  ()ttiy 


26x1^?  POV  displayed  acfo 
(!>40x4Kd  pixels 


Tojjpk.*  switch  (with  2  tictcntsl 


I  switch  (sprinp  headed  in 

I  2  directions  wjth  neutral  in 
I  middlci 


I  Hi.  Push  button  (tor  Ul  KIlSfTt 


'}  isj,yeK‘  switch  (^pfing  ktaJed  m 
2  directions  with  hijutral  (n 
middle)  *  common  push  hytton 
KI;SFT  with  coom  mode) 


'I  oitcie  switch  (spritt):  loaded  m 
l  dirsvtiort  .so  normally  in  direct 
\  iew'  mode  hut  cliatt|teabic  t<' 
rear  vvse  if  hold  swaich  m 
.sprmp  loaded  drrectinni  OR 
push  Hutton  twlth  rear  vis*w 


I  "I  sso  pashhuuoov 
j  1  >  I  X‘sipnate/track  target  and 
!  2  ■>  Track  helmet 


Visible  scasor  only  is  /.ootned, 
‘/f^ovn  can  he  activated  in  all 
nttxics  belovv,  but  only  tlK' 
hstad-tr’tivhed  display  will  lie 
zttt'imed,  while  the  lary.et'' 
tracked  view  i.^  not  /oonx'd. 


i  ii»  stitch  bump  of  the  lotigk 
switch,  tlx*  ret  icie  i.s  changed 
ut  a  htrper  or  smaller  n'ltcle 
si/c.  Kesel  switch  rs’sH)rs‘^s 
reticle  to  miemai  orx:. 


Visible  SiOnsoronly,  Ihnu  view 
or  rear  view.  Kearviewis 
1H0'“  trout  current  head  iraeker 
positton,  and  may  txi  direct 
tmage  or  mitTor^:d  itnage  (ptV'^ 
determined  b>'  developer). 


Crimmander  designates  target 
by  pressing  button  wlxm  target 
is  ^within  maicte.  Visthle 
sensor  continvie.s  to  track  target 
wdiilc  commander  ctm  look  lor 
new  targets  in  a  second  view 
of  dx'  same  wm.sor  I  i>ev.,  the 
.second  vk'w^  slews  in  respoosi.* 
to  hs’asl  ntotkstt).  <,!oordinaies 
of  tracked  target  remain 
^zeessiblc  to  vehicle  to  enahle 
lun'Ct  i(>  be  slesvstd  to  target 
wlten  desired 

'ritrytl  tmekin))  feature  is 
iv^lCii-W'd  and  visible  sensor  is 
slewed  by  head  b  acker. 


1  Xrsgttpi  Imt  of  Opera  t  ion 


!R  Sensor  Only 


tXh  b<)V  displayed  in 
appropriate  suhsii  of  displav 
r-ov 


tnsstrt.s  mwk'  bit-s  of  I  K  sensem 
only. 


IH  senMvr  only  is  ^ootoed, 

/ocim  can  K*  activated  in  n!l 
moilcs  below',  but  only  the  bead- 
tracked  display  will  he  «:»imjcd. 
whik  the  target -tracked  view  j,c 
not  /.tH)me<i 


l  or  each  bump  of  the  loggk' 
switch,  thtr  reticle  i.s  dunged  to 
a  krger  or  smaller  anick  size, 
Ket^^t  switdi  restores  tvticle  to 

onginal  one. 


IR  sensor  only,  front  view  or 
rear  view.  Rear  view-  is  I  Jit)  ' 
tfom  current  head  tracker 
position,  and  may  he  dim-ci 
image  or  mirrored  image  eprir- 
determined  hy  developerX 


t/omntande?  designates  target  by 
pre.ssmg  Ntbort  when  target  is 
within  nnklv.  IK  .voxsor 
continues  to  track  target.  When 
commander  lor>ks  away  from 
target,  the  target  xlides'olf  the 
display  and  tlkr  commander  no 
longer  siXts  the  IK  sensor. 
I’oordmaies  of  tracked  target 
remam  accessibic  to  vehicle  to 
enable  turrert  to  he  skwed  to 
target  when  desired, 

’garget  tracking  lemnre  is 
ri‘k’aM.*d  and  IK  sensor  Is  slowed 
bv  Ixnid  tracker. 


Visible  &  iK  J^msor 


26x1  M  visible  H)V  displayed 

w»thl5.5xn.bmR>V 

&upertmpo,sed 


Ittuiris  image  bds  of  IR  senM>r 
only. 


Zoom  can  ht*  aciivmted  in  all 
tnode^  K’'k)v,\  hut  tmly  the 
bead-iTaeked  display  will  be 
Zixmvd,  w^hile  the  btrget- 
fracked  view  is  mit  zoomed,  If 
bciid-triickal  display  is 
viewing  both  tscasofi,  then 
btith  .sensors  are  aor>«ied 
togelber.  CHherwisc,  only  the 
senstir  btilng  dlsplaycAl  sviM  be 
ZAXitned 


Tor  each  bump  olThe  toggle 
switch,  the  retkdc  iscfctngcd 
ui  a  large?  or  smaller  ftrtk’le 
size.  Reset  .switch  rcjaorcs 
jx^fcle  to  original  one. 


Both  IR  and  visible  seasi>f.s. 
front  view  or  rear  view.  Rear 
view  is  IStt'^  from  current  bead 
tracker  pti.sitton.  and  ntay  be 
ditxxt  rmage  or  rnttrored" 
image  ipfe-determioed  by 
deseii»ptrr). 


Commassler  tk’.signaies  urggi 
by  imessmg  button  when  target 
is  within  reiscle.  IR  setisor 
continues  to  track  target, 
Commamlcr  can  look  for  tx*w 
targei.s  m  the  vetihle  sensor 
(i,c..  the  vi,sibk'  scri^of  slews 
in  resfxm.sc  to  head  motion), 
f’oordimitcs  of  tracked  target 
remain  accc-ssihle  to  vebicte  to 
ctuMe  turret  to  he  slewed  tn 
target  when  desired 

Target  tracking  ftraiure  rs 
released  and  htith  visible  and 
1 R  .siiuisors  are  slewed  hs'  head 
tracker,  w^h  IK  imagery 
sttpcrimpo,scd  or  ’’tiised”  onto 
visible  irnawry 


Tushbutton  switch  ».sstKhau‘s  current  head  position  wiih  visible  and  I  K  sensor  hues 
sensor  modes. 


sight  litcing  loihe  from  of  the  tuitct,  i%i;tivc  in  all 


rite  retr.  k-  t>:v.  m-'c.  and  shap<'  can  Is.*  co.siH'  Changed  hy  modiS'ymg  a  reticle  fik*  in  tin"  .sohwarc. 

Tti<-  tracker  wd:  irack  whatever  f,s  inside  a  reticle  whose  sire  can  Ix’  varied  at  the  operalor’.s  cammimd. 

Ke-ir  stew  dcimec  !<<  Iv  tbedio'Ct  vxnv  ti.c„  not  inverted  leh-Tighs)  iHn '  in  hack  o1  ds.*Comimmde?\s  Itead  current  licad  position. 

Sen.M>:  inufvery  is  aligned  to  the  head  w  nh  three  degrees  oC  bx-edorn;  i.e..  ii/.imuth.  elcvatiob.  and  head  till.  The  user  cr.n  initxtit/.e  tite  tensor  line  srf  xlght  to  be  c<>jncidcnt  with  his  head 
a/umifh  and  eievaiMn  at  a  time  whr:ri  the  User  is  looking  forward  m  the  vehicle.  Tlx*  Ph  degree;  of  iVeedom  cimnot  bit  miiinli/cd  at  this  iinx*. 

The  priXYvsin-  wdi  warp  2*'  pr^mjration  Id  ..{R  inmgery  in  real  time  .so  thtit  1 I  imagsrry  can  K*  displaycti  properly  on  a  Corvuimrstial  I :  I  dt^i^play.  Tins  itiacUdrt  has  not  yet  heert  tested. 

The  table  .should  luivc  aooihcf  Column  ertuth’d  *'2'^^  getteraiion  t‘l,JK  only”,  Use  only  rrmdcs  implemented  in  this  cr>himn  should  he  the  dr-splay  pohsriiyand  zoom  select  modes. 
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The  prototype  STTV  system  uses  a  laptop  computer  as  a  control  panel  for  development  purposes 
to  facilitate  system  changes  and  to  aid  in  software  development.  In  a  deployable  STTV  system 
the  laptop  computer  will  not  be  used  and  the  commander’s  control  panel  will  communicate 
directly  with  a  ruggedized  version  of  the  PVT-20(3  processor. 


Figure  36.  Integrated  STTV  system 


3.6  Deployable  System  Features 

The  prototype  STTV  system  is  u.seful  for  demonstrating  system  operation,  but  does  not  address 
all  of  the  sy.stem  requirements  because  it  uses  existing  components  to  reduce  development  cost. 
A  deployable  STTV  system  will  use  improved  components  that  are  better  matched  to  the  sy.stem 
requirements.  It  will  also  have  additional  image  processing  lunctions  and  more  complete 
integration  into  the  vehicle  systems.  Table  14  shows  some  of  the  improvements  envi.sioned  in  a 
deployable  STTV  sy.stem. 


One  major  improvement  is  upgrading  the  360°  panoramic  .sensor  from  visible  sensitivity  to  8-12 
micron  sensitivity.  One  alternative  for  achieving  this  is  by  using  a  parabolic  metal  mirror  and  a 
single  staring  HgCdTe  focal  plane  having  2048x2048  pixels.  A  prototype  sensor  of  this  type 
having  a  640x480  pixel  focal  plane  has  already  been  developed.  Alternatively,  it  may  be 
possible  to  mosaic  several  640x480  pixel  microboiometer  focal  planes  to  achieve  a  similar  result. 
Sensor  resolution  can  be  improved  by  the  use  of  larger  focal  planes  with  more  pixels  and  by 
micro-scanning  techniques.  A  suitable  IR-transparent  cylindrical  window'  wall  also  be  supplied. 
Protection  against  small  arms  fire  can  be  provided  in  the  form  of  a  retractable  armor  cylinder  that 
can  be  raised  or  lowered  around  the  sensor  or,  alternatively,  by  elevating  the  sen.sor  out  of  a 
protective  well. 


The  gimbaled  IR  sensor  can  be  improved  by  using  a  second  generation  FLIR  having  1316x480 
pixels  and  dual  field  of  view  optics.  This  sen.sor  is  already  available  on  some  armored  vehicles. 
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and  additional  vehicles  will  be  receiving  it  as  an  upgrade  package.  If  an  8-12  micron  360" 
panoramic  sensor  is  provided  as  described  above,  a  second  generation  FLIR  may  not  be  needed 
if  the  range  of  the  panoramic  sensor  exceeds  the  range  of  the  vehicle’s  weaponry. 

Table  14.  Improvements  envisioned  in  a  deployable  STTV  system 


Function 

Prototype  System 

Deployable  System 

360"  panoramic  sensor 

Visible  sensitivity  i 

8  cameras 

5120(H)  x480  (V)  pixels 
acrylic  window 
unshielded 

8-12  micron  sensitivity 

1  camera 

8000(H)x500(V)  pixels 
IR-transparent  window 
retractable  armor  shield 

Gimbaled  TR  sensor 

320x240  microbolometer 

15.5"(H)xil.5"(V)FOV 

optics 

1316x480  2""  gen  FLIR 
sensor 

dual  narrow  &  wide  FOV 
optics 

HMD  display 

640x480  monochrome 
HMD 

26"xl9"  FOV 

800x600  color  HMD 
wider  FOV 

Head  tracker 

commercial  inertial 
tracker 

metal-toleranl  magnetic 
tracker 

Image  processor 

8-slot  PVT-200  processor 

Next  generation  PVT 
processor 

Image  processing 
functions 

image  stitching 
electronic  zoom 
visible/IR  fusion 
moving  target  tracking 

+  wider  display  FOV 
+  image  stabilization 

4-  2”^*  viewer 
-t-  UAV  imagery 
-  visib!e/lR  fusion  (not 
required) 

Vehicle  integration 

non-integrated 

Sensor  integration  with 
vehicle 

STTV  control  integration 
FBCB2  display  integration 

2"^’  gen  FLIR  integration 

Fire  control  system 
integration 

Embedded  training 

Embedded  maintenance 

The  helmet-mounted  display  can  be  improved  by  upgrading  to  an  800x600  pixel  color  flat  panel 
display  to  increase  resolution  and  to  improve  color  contrast  for  FBCB2  map  information.  The 
higher  resolution  flat  panel  display  will  also  have  a  wider  field  of  view  that  will  add  more 
content  to  the  sensor  imagery.  The  head  tracker  will  be  a  metal -tolerant  magnetic  tracker  with 
electronics  that  fit  onto  a  single  card.  The  single  card  construction  will  aid  significantly  in 
reducing  tracker  cost.  A  prototype  of  this  tracker  has  been  proven  effective  on  an  Ml  13  armored 
vehicle"'’,  and  transition  to  manufacturing  is  currently  in  progress. 
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The  deployed  system  will  include  additional  image  processing  functions  such  as  higher  sensor 
resolution,  wider  display  field  of  view,  electronic  image  stabilization,  provision  for  a  second 
independent  viewer  of  the  360°  panoramic  camera  imagery,  and  provision  for  displaying 
Unmanned  Aerial  Vehicle  (UAV)  reconnaissance  imagery.  These  additional  functions  will 
require  higher  processor  throughput,  which  will  be  achieved  by  using  a  next  generation  PVT 
processor. 

Most  importantly,  the  deployed  system  will  be  integrated  into  the  vehicle  and  its  systems  much 
more  effectively  than  the  prototype  system.  The  STTV  sensors  will  be  mounted  on  the  outside 
of  the  vehicle  in  a  manner  that  protects  them  from  abuse  and  in  a  location  that  increases  their 
effectiveness  without  compromising  other  vehicle  sensors  or  functions.  The  STTV  controls  will 
be  mounted  inside  the  vehicle  in  a  location  that  is  accessible  to  the  commander  while  he  is 
.standing  in  the  hatch  or  with  the  vehicle  buttoned  up.  The  controls  will  be  integrated  with  the 
second  generation  FLIP  sensor  controls  and  the  vehicle  fire  control  system  so  that  the  hunter- 
killer  teamwork  between  the  vehicle  commander  and  the  gunner  can  be  maintained.  The  STTV 
helmet-mounted  display  will  be  integrated  with  the  FBCB2  tactical  terminal  and  second 
generation  FLIP  so  that  FBCB2  information  and  second  generation  FLIP  imagery'  can  be 
displayed  effectively  and  still  be  controlled  properly  by  the  originating  systems.  Finally,  the 
STTV  system  will  be  integrated  with  new  systems  still  in  development  for  embedded  training 
and  embedded  maintenance  that  offer  the  possibility  of  reducing  vehicle  life  cycle  cost. 

3.7  Vehicle  Applications 

The  STTV  system  is  designed  primarily  for  turreted  armored  vehicles,  such  as  the  Ml  Abram.s 
and  the  M2  Bradley  (Figure  37).  It  is  u.sua!ly  these  vehicles  that  impose  the  heaviest  demands  on 
the  vehicle  commander’s  workload.  However,  non-turreted  armored  vehicles,  such  as  the  Ml  13, 
are  also  potential  insertion  candidates.  New  armored  vehicles  currently  in  development,  such  as 
the  Crusader,  the  Future  Scout  and  Cavalry  System  (FSCS),  the  Future  Combat  System  (FCS), 
and  the  new  family  of  Medium  Armored  Vehicles  are  considered  to  be  especially  strong 
candidates  for  the  STTV  system.  The  FCS  program  has  formally  identified  the  need  for  a 
panoramic  sensor.  The  U.  S.  Army  Tank  Automoti\'e  and  Armaments  Command  (TACOM)  has 
also  investigated  the  use  of  a  panoramic  .sensor  with  helmet-mounted  display  as  a  see-through 
turret  system  for  this  purpose. 


FSCS-Tracer  FCS  LAV-II  Auto-Loader 


Figure  37.  Vehicles  identified  for  STTV  insertion 

3.8  System  Evaluations  and  Demonstrations 

The  prototj'pe  STTV  system  was  evaluated  on  a  HMMWV  vehicle  at  the  Sarnoff  Corporation  on 
3  May  00  (Figure  38).  The  STTV  system  included  the  visible  and  IR  .sensors,  image  processor. 
InterSensc  head  tracker,  commander’s  control  panel,  and  power  supply.  Image  processing 
software  for  warping,  stitching,  zooming,  mterpoiaiing,  and  displaying  both  sensors  was 
operational,  along  with  head  tracker  and  reticle  operation.  Software  for  target  tracking  and 
automatic  camera-to-camera  brightness  adjustment  was  not  yet  operational.  A  surrogate  head- 
mounted  display  (Sony  Glasstron)  was  used  in  place  of  the  Land  Warrior  display.  The  vehicle 
contained  a  1  kW  battery-fed  110  VAC  inverter  plus  a  gasoline-operated  generator  for 
recharging  the  battery. 

Imagery  from  the  visible  and  IR  sensors  was  observed  under  varying  conditions  of  ambient 
brightness,  target  contrast,  target  range,  head  motion,  and  vehicle  motion.  The  IR  imagery  was 
clear  and  relatively  noise-free  once  the  IR  sensor  had  gone  through  its  internal  calibration 
procedure.  The  visible  imagery  was  noise-free,  but  did  not  have  as  good  a  re.solution  as  the  IR 
imagery.  Nevertheless,  it  was  easy  to  detect  and  track  objects  such  as  humans,  automobiles,  and 
wildlife  at  ranges  of  100  to  400  meters.  Stitching  of  the  visible  imagery  from  adjacent  cameras 
was  very  smooth,  but  brightness  variations  from  camera  to  camera  made  it  possible  to  discern  the 
camera  stitching  locations.  It  was  difficult  to  adjust  the  brightness  levels  by  hand  so  that  all 
cameras  had  the  same  brightness  level. 


46 


The  InterSense  head  tracker  worked  well  while  the  STTV  system  was  powered  from  the  battery 
with  the  generator  off.  The  tracker  operated  acceptably  even  while  the  vehicle  was  moving, 
w'hich  might  be  a.scribed  to  the  lack  of  metal  in  the  HMWWV  vehicle  (it  had  a  canvas  roof,  for 
example).  Latency  was  nearly  unnoticeable  for  the  gimbaled  infrared  (IR)  sensor,  but  was  much 
slower  for  the  visible  sensor.  When  the  STTV  system  w'as  operated  with  the  generator  on,  the 
head  tracker  would  drift  continuously. 

Approximately  tw'o  hours  worth  of  sensor  imagery  was  recorded  on  digital  tape  using  a  Sony 
450X  digital  camcorder.  The  digital  imagery  was  edited  into  a  two-minute  long  repeating  VHS 
video  tape  that  could  be  shown  on  a  helmet  half-shell  display  at  the  AUSA  show  later  in  the 
month. 


Figure  38.  System  evaluation  at  the  Samoff  Corporation  on  2-4  May  00 

The  STTV  system  was  demonstrated  for  the  first  time  at  the  Fort  Knox  Armor  Conference  on  22 
to  24  May  00  (Figure  39).  The  system  configuration  was  identical  to  the  one  evaluated  at  the 
Sarnoff  Corporation  on  3  May  00.  except  that  the  imagery  was  displayed  on  a  surrogate  Land 
Warrior  helmet-mounted  display  mounted  on  a  half  shell.  The  surrogate  display  was  a  640x480 
pixel  monochrome  display  with  the  same  optics  and  AMEL  flat  panel  display  as  Land  Warrior 
display,  but  with  different  controls  tmd  drive  circuitry  (Honeywell’s  mtirketing  demonstration 
unit).  The  InterSense  head  tracker  w'as  located  on  the  table  under  the  half  shell  so  that  an 
obsers'er  could  easily  pan  and  tilt  the  imagery  by  hand.  A  CVC  helmet  with  the  STTV  display 
and  STTV  display  mount  was  exhibited  separately  on  a  mannequin.  The  visible  and  IR  imagerx' 
was  excellent,  although  the  brightness  adjustment  from  camera  to  camera  was  still  done  by  hand. 
The  exhibit  attracted  a  lot  of  attention  from  active  Army  personnel.  Many  armor  sergeants  noted 
that  something  like  this  was  needed  on  Abrams  and  Bradleys. 


A  second  STTV  demonstration  was  given  at  the  AUSA  Annual  Meeting  in  Washington,  DC,  on 
16-18  October  00  (Figure  40).  The  STTV  system  was  part  of  a  UDLP  exhibit  showing  LJDLP's 
a!l-eleciric  vehicle.  The  STTV  system  configuration  w-as  identical  to  the  one  demonstrated  at  the 
Fort  Knox  Armor  Conference  on  22-24  May  00,  except  that  a  track  ball  was  used  for  panning  the 
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Section  4.0  Conclusions 


This  report  documents  the  results  of  contract  DAAN02-98-C-4034,  See-Through  Turret 
Visualization  Program.  The  program  was  sponsored  by  Dr.  Norman  Whitaker  of  DARPA/ITO 
under  DARPA/fTO’s  Warfighter  Visualization  effort.  It  was  managed  by  Mr.  Henry  Girolamo 
of  the  U.  S.  Army’s  Natick  Soldier  Systems  Center,  Honeywell  Inc.  was  the  prime  contractor 
and  the  Sarnoff  Corporation  was  the  major  subcontractor. 

The  program  resulted  in  the  following  major  accomplishments; 

•  surveyed  Army  users  to  understand  the  needs  of  an  armored  vehicle  commander  for 
situation  awareness  information, 

•  wrote  a  system  requirements  specification  documenting  the  needs  of  an  armored 
vehicle  commander  for  situation  awareness  information, 

•  performed  trade  studies  to  identify  the  optimum  solution  for  meeting  the  system 
requirements, 

•  created  a  prototype  system  development  specification  that  defines  a  system 
architecture  having  a  sensor,  image  processor,  and  helmet-mounted  display  capable  of 
.satisfying  the  vehicle  commander’s  needs  for  situation  awarene.ss  information. 

•  developed  hardware  and  software  for  a  prototype  system  capable  of  demonstrating 
the  essential  features  of  the  visualization  system  on  a  non-moving  armored  vehicle. 
Specifically,  the  program  developed; 

•  a  360®  FOV  panoramic  sensor  having  eight  visible  CCD  cameras  and 
capable  of  simultaneous  readout  by  two  different  users, 

•  a  gimbaled  IR  .sensor  with  uncooled  IR  focal  plane  and  high  speed  pan/tilt 
capability, 

•  IR  image  processor  hardware  and  software  capable  of  real  time  image 
warping,  mosaicing.  target  tracking,  sensor  fusion,  displaying,  and  controlling 
the  operation  of  the  visible  and  IR  sensors, 

•  a  commander’s  control  pane!  for  controlling  the  panoramic  and  gimbaled  IR 
sensors  while  the  commander  is  standing  in  the  hatch  or  buttoned  up  inside 
the  vehicle, 

•  a  display  mounting  approach  for  mounting  the  Land  Warrior  display  on  a 
CVC  helmet  while  retaining  full  use  of  sand,  wind  and  du.st  goggles  and 

the  vehicle’s  optical  sights  and  while  avoiding  problems  with  head  clearance, 
cable  snagging,  and  emergency  egress, 

•  identified  candidate  armored  vehicles  that  can  benefit  from  using  the  STTV  system, 

•  identified  STTV  .sensor  and  control  mounting  locations  on  the  candidate  vehicles, 

•  identified  an  armored  vehicle  for  hosting  a  final  system  demonstration, 

•  conducted  demonstrations  of  the  prototype  system  at  the  Fort  Knox  Armor 
Conference  and  the  annual  AUSA  meeting, 

•  identified  system  improvements  that  can  be  included  in  a  deployable  STTV  sy.stem, 

•  delivered  a  paper  at  the  SPIE  Conference  describing  the  STTV  system. 


Lessons  learned  from  the  prototype  STTV  system  were  as  follows: 

*  The  mount  for  the  Land  Warrior  display  on  the  CVC  helmet  provides  an  effective 
solution  for  mounting  the  display  on  the  CVC  helmet. 


49 


•  A  helmet-mounted  display  with  head  tracker  can  display  the  vehicle’s  CITV/CIV 
sensor  imagery  when  buttoned  up.  However,  current  armored  vehicle  sensors  (e.g., 
the  Abrams  CITV  or  the  Bradley  CIV),  pan  very  slowly  (approximately  607sec)  and 
thus  introduce  objectionable  latency  with  normal  head  motion.  Therefore,  a 
specialized  STTV  sensor  having  a  faster  panning  rate  (approximately  1207sec)  is 
required  for  use  with  a  head-mounted  display  and  head  tracker. 

•  The  resolution  of  the  visible  panoramic  .sensor  was  less  than  that  of  the  gimbaled  IR 
sensor.  The  number  of  panoramic  sensor  pixels  displayed  was  limited  by  the  display 
field  of  view'  to  be  26/56  x  640  =  297  pixels  across  the  26“  horizontal  field  of  view',  or 
1 1 .4  pixels  per  degree.  The  number  of  IR  sensor  pixels  displayed  W'as  320  pixels 
across  a  15.5“  horizontal  field  of  view,  or  20.6  pixels  per  degree.  This  assumes  that 
helmet-mounted  display  is  designed  so  that  the  field  of  view'  of  the  displayed  imagery 
is  equal  to  the  angular  subtense  of  the  display  in  front  of  the  eye  in  order  that  the 
di.splayed  imagery  overlaps  1:1  with  the  real  world  (even  if  the  display  is  not  a  see- 
through  display).  This  condition  is  known  to  minimize  motion  sickness,  which 
worsens  when  the  displayed  imagery  moves  at  a  different  speed  than  the  head  motion 
(e.g.,  when  the  imagery  is  zoomed  in  or  out). 

•  Panoramic  sensor  resolution  can  be  improved  by  using  CCD  cameras  having  a  larger 
number  of  pixels. 

•  The  latency  of  panning  the  visible  panoramic  sensor  with  the  head  tracker  was  longer 
than  the  latency  of  panning  the  gimbaled  IR  .sensor.  This  latency  was  due  to 
processing  delays  in  the  image  processor  software. 

•  Fusion  of  the  IR  sensor  imagery  with  the  visible  panoramic  imagery  w'as  hampered 
by  the  parallax  between  the  IR  and  visible  imagery  caused  by  the  vertical  offset  of  the 
camera  focal  points  (approximately  16  inches). 

•  The  tracking  of  a  target  as  it  passes  from  one  visible  sensor  in  the  panoramic  camera 
to  another  complicates  the  software  tracking  algorithms. 

•  The  PVT-2()0  image  processor  throughput  w'as  fully  utilized  for  the  functions  of 
image  w'arping,  mosaicing.  displaying,  and  target  tracking.  The  inclusion  of 
additional  image  processing  functions  (such  as  a  .second  view'er  with  independent 
panning  capability)  w'ill  require  eliminating  some  existing  function  (such  as  target 
tracking),  or  the  expansion  of  image  processor  throughput. 

•  The  prototype  STTV  system  is  capable  of  being  demonstrated  on  a  non-moving 
armored  vehicle. 

•  Operation  of  the  prototype  STTV  system  on  a  moving  armored  vehicle  will  require 
improvements  in  the  head  tracker  (e.g.,  optical  updating  of  the  inertia!  sen.sor)  or  use 
of  a  metal-loierant  head  tracker  (e.g.,  Honeywell’s  .AMTT  head  tracker). 

•  Funding  limitations  precluded  full  sysstem  evaluation  with  armored  vehicle 
commanders. 

As  a  result  of  the  les.sons  learned  from  the  prototype  STTV  system,  the  following  conclusions 
can  be  drawn  about  a  deployable  STTV  system: 

•  A  deployable  STTV  system  can  provide  the  real  time  sensor  and  FBCB2  situation 
awareness  information  required  by  an  armored  vehicle  commander. 

•  A  deployable  STTV  helmet-mounted  display  alone  (800x600  pixel  color  display  and 
helmet  mount  w'ithout  sensor  and  image  processor)  satisfies  all  the  requirements  of 
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the  vehicle  commander  for  FBCB2  situation  awareness  infomtation  while  standing  in 
the  hatch  with  the  head  outside  the  vehicle.  This  provides  a  solution  to  meeting  the 
most  urgent  needs  of  the  vehicle  commander  for  situation  awareness  information. 

•  A  helmet-mounted  display  with  a  wider  field  of  view  (e.g.,  40®x30°  or  greater)  can 
provide  more  situation  awareness  sensor  information  to  the  vehicle  commander  than 
the  26®xl9''  FOV  Land  Warrior  Display.  A  larger  field  of  view  display  would  better 
match  the  field  of  view  of  the  cameras  in  the  panoramic  camera  (56®  horizontal  FOV) 
and  would  not  throw  away  as  much  useful  sensor  information  as  the  26®xl9“  Land 
Warrior  display.  Helmet-mounted  displays  are  limited  to  approximately  40® 
monocular  field  of  view  by  optics  design  considerations.  Panel-mounted  displays  can 
have  fields  of  view  greater  than  40°  by  tiling  multiple  displays.  Panel-mounted 
displays,  however,  can  not  be  used  to  display  the  FBCB2  information  to  the 
commander  when  he  is  standing  in  the  hatch  with  his  head  outside  the  vehicle. 

•  Adding  a  visible  CCD  camera  to  the  gimbal  containing  the  IR  sensor  can  provide 
higher  resolution  CCD  imagery  with  less  latency,  and  less  IR-to-visible  sensor 
parallax,  than  the  imagei^  provided  by  the  visible  panoramic  camera  in  the  prototype 
STTV  system.  A  visible  CCD  camera  on  the  gimbal  also  allows  greater  flexibility  in 
selecting  a  higher  resolution  (e.g.,  1320  x  480  pixels)  monochrome  CCD  camera,  or  a 
color  CCD  camera,  with  less  expense  than  a  panoramic  camera  approach.  One  can 
also  add  a  zoom  lens  to  the  camera  that  provides  higher  resolution  imagery  when 
zoomed,  in  contrast  to  the  electronic  zoom  on  the  panoramic  camera,  which  decreases 
in  resolution  when  zoomed.  Finally,  image  processor  throughput  can  be  subslantsally 
reduced  by  eliminating  the  need  for  multi-camera  image  warping  and  mosaicing, 
leaving  more  processor  throughput  for  target  tracking  functions.  This  might  make  it 
possible  to  use  a  lower  cost  commercial  PC  computer  for  target  tracking  instead  of 
the  relatively  expensive  PVT-200  processor.  The  only  penalty  of  this  approach  is  the 
inability  of  the  gimbaled  camera  to  display  two  different  fields  of  view 
simultaneously  (e.g.,  to  the  vehicle  commander  and  a  squad  leader).  This  is  not  much 
of  a  penalty  because  displaying  two  different  fields  of  view  at  the  same  time  requires 
additional  processor  throughput  that  is  not  currently  available  in  the  prototype  STTV 
system.  Also,  it  is  possible  minimize  this  penalty  by  designing  the  system  control  to 
allow  the  vehicle  commander  to  pass  the  sensor  panning  control  to  the  squad  leader 
prior  to  exiting  the  vehicle  and  then  to  re-establish  his  own  panning  control  after  an 
exit  is  made. 

•  Adding  a  second  microbolometer  IR  sensor  with  a  4C)‘'x3()°  FOV  to  the  gimbal 
already  containing  a  microboiometer  sensor  with  a  15.5°xll.6°  FOV  can  provide  a 
dual  field  of  view  IR  sensor  with  8-12  pm  sensitivity  and  higher  resolution  than  an 
electronic  zoom,  and  possibly  at  lower  co.st  and  smaller  size  than  single  IR  sensor 
with  a  dual  field  of  view  lens  having  8-12  pm  transmissivity. 
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Section  5.0  Recommendations 


It  is  recommended  that  the  prototype  STTV  system  be  evaluated  on  a  moving  armored  vehicle 
with  real  FBCB2  information.  This  wiJi  allow  evaluation  of  the  helmet-mounted  display  in  the 
mode  where  the  commander  is  standing  in  the  hatch  with  his  head  outside  the  vehicle  as  well  as 
the  mode  where  the  commander  is  seated  inside  the  vehicle  looking  at  sensor  information. 
Operation  on  a  moving  armored  vehicle  requires  improvement  of  the  head  tracker,  which  may  be 
accomplished  by  adding  an  optical  head  tracker  to  the  cument  STTV  inertial  head  tracker.  If 
evaluation  cannot  be  performed  on  an  armored  vehicle  having  FBCB2  information,  then 
consideration  should  be  given  to  evaluating  the  system  on  an  armored  vehicle  without  FBCB2 
information  as  a  test  of  the  STTV  sensor  capabilities. 

It  is  also  recommended  that  development  proceed  on  a  lower  cost  and  higher  performance 
deployable  STTV  system  having  the  following  improvements  over  the  prototype  STTV  system: 

•  Retain  the  helmet  mount,  commander’s  control  panel,  and  gimbaled  IR 
microbolometer  sensor. 

•  Improve  the  monochrome  26‘^’xl9'’  FOV  640x480  pixel  prototype  helmet-mounted 
display  to  a  color  40'’x30‘’  FOV  800x600  pixel  helmet-mounted  display. 

•  Add  a  color  749x483  pixel  CCD  camera  with  40^x30^’  FOV  zoom  lens'  to  the  gimbal. 

•  Improve  the  IR  sensor  from  a  640x480  pixel  microbolometer  sensror  wuth  a 

1 5.5®x  1 1 .6'’  FOV  lens  to  a  640x480  pixel  microbolometer  sensor  wuth  a  40'’x30"  lens 
w’hen  the  larger  microbolometer  sensors  become  available. 

•  Add  an  optical  tracker  to  the  current  inertial  tracker  to  make  the  tracker  more  metal 
tolerant. 

•  Substitute  a  PC-based  processor  for  the  PVT-200  processor  for  target  tracking  and 
system  control. 

•  .Add  a  cursor  to  the  commander's  control  panel  to  allow  preparation  of  FBCB2 
reports  while  standing  in  the  hatch  with  head  out. 

•  Add  a  switch  to  the  commander's  control  panel  for  temporarily  passing  the  gimbal 
panning  control  to  a  squad  leader  on  the  vehicle. 

•  Evaluate  the  improved  STTV  system  on  moving  armored  vehicle  w'ith  real  FBCB2 
information. 


This  document  reports  research  undertaken  at  the  IkS.  Army 
and  Biological  Chemical  Command,  Soldier  Systems  Center, 
been  assigned  No.  NATICK/TR-^^^.IDjn  a  series  of  reports 
for  publication. 


Soldier 
,  and  has 
approved 


52 


Page  Intentionally  Left  Blank 


\ 


53 


Page  Intentionally  Left  Blank 


54 


Appendices 


Page  Intentionally  Left  Blank 


56 


Appendix  A 

STTV  System  Requirements  Specification 


Honeywell 


TYPE:  nri  SYSTEM 


Sensor  and  Guidance  Products  Divison 


MINNEAPOLIS,  MN 
.ST.  PETERSBURG,  FL 


FSCM  94580 
FSCM  09128 


.SPECIFICATION  NO. 


DSXXXXX-01 


DEVELOPMENT 

PRODUCT 


MATERIAL  |  | 

PROCESS 


ENGINEERING 

OTHER 


TITLE:  .System  Requirements  Specification  for  a  See-Through  Tank  Visualization  Sy.stem 


WEngnt  I  \SrrV\Specs\STTVSysicmRcciuirerrientsSpec.doc,  ! ()/29/()  1  9:0  i  AM 


58 


^  u>  Vi  vi  v)  vi  vi  v>  Vi  vj  vi  vi  u>  v>  oi  vi  vi  Ui  vi  Vi 


Table  of  Contents 


1.  SCOPE . 

2.  REFERENCE  DOCUMENTS . 

3.  SYSTEM  REQUIREMENTS  /  USER  NEEDS 

3.1  System  Objectives . . . 

3.1.1  System  User . . . 

3.1.2  Occasion  of  Use . . . 

3.1.3  System  Applications . 

.1.3.1  Driver  Assistance  Application . 

.  1 .3. 1 . 1  Road  Hazard  Detection . . . 


. 61 

. 61 

. 61 

. 61 

. ...61 

. . 61 

. 62 

. 62 

. . 62 


.  1 .3.1.2  Detection  of  Nearby  Vehicles,  Dismounted  Troops.  Structures . 63 

.1.3. 1.3  Driver  Backup  Assistance . . . . 64 

.  1 .3. 1 .4  Requirements  Supporting  Driver  .Assistanc&:A-nol^l^^ . !... . .64 

.  1 .3.1 .4. 1  Field  of  Regard . 64 

.1.3.1 .4.2  Field  of  View . 64 

.1.3.1 .4.3  Focus . 64 

.  1 . 3 . 1 .4 .4  Detector  W avelength . 65 

.1.3.1 .4.5  Latency . 65 

.1.3.2  Ground  Threat  Detection  Applict^n  . . . 65 

.1.3.2. 1  System  Requirements  Supp{^in|A»ui^pfareat  Detection  Application . 66 

.1.3.2. 1.1  Field  of  Regard . 66 

.  1 .3.2. 1 .2  Field  of  View . 66 

.1.3.2. 1.3  Resolution . 66 

.  1 .3.2. 1 .6  Latency . 66 

.1.3.3  Display  of  Dat^om^pytaander’s  Viewer  and  Tactical  Display  While  in  Open  Hatch67 

.1.3.3.1  FLIR  Sems^ftSly  ..U^t . . . 67 

,1.3.3. 1.1  FLIR  Di^lv  Ipolution" . . . 67 

,  1 .3.3.1 .2  FLIR  Dip|>:;iolor . 67 

,1.3. 3. 2  Tactical  Dispkn^V. . 68 

,1.3. 3.2.1  Tactical  Di.splay  Resolution . 68 

.1.3.3. 2. 2  Tactical  Di.spiay  Color . 68 

,1.3.4  Display  of  UAV  Infonnaiion . . . 68 

1 .3.4. 1  RF  Data  Link  Interface . 68 

1. 3.4.2  UAV  Display  Re.solution . 68 

,1. 3.4.3  UAV  Display  Color . -. . 68 

2  Vehicle  Compatibility . 68 

3.2.1  Vehicle  Types  Supported . . . 69 

3.2.2  Vehicle-Related  System  Requirements . ....69 

3.2.2. 1  Sensor  Mounting  Location . 69 

3.2.2.2  Display  Electronics  Location . . . . . 69 

3.2.2. 3  Display  Controls  Acces,sibility . . . . . 69 

3.2.2.4  Display  Mounting  on  Helmet . . . . . . 69 


.4. 1  Field  of  Regard . 


.1.3. 1.4.2  Field  of  View . 

.1.3. 1.4.3  Focus . 

.  1 .3. 1 .4.4  Detector  Wavelength . 
.1.3. 1.4.5  Latency . 


59 


3.2.2.5  Display  Cable . . 

3.2.2.6  Quick  Disconnect  Connector... . . . 

3.22.1  Light  Leakage . 

3.3  Composite  STTV  System  Performance  Requirements 

3.3.1  Sensor  Performance . . . 

3.3.2  Display  Performance . 

3.3.3  System  Performance . 

3.3.4  Human  Factors  Requirements . . . 

3.4  Acronyms . 


. 70 

......70 

. 70 

. 70 

. 70 

. 71 

. 71 

. 71 

....:'.71 


60 


1.  SCOPE 


This  specification  establishes  the  user  needs  for  a  See  Though  Tank  Visualization  System 
(STTV).  The  user  needs  define  the  performance  and  interface  features  of  the  required  system, 
but  do  not  specify  the  system  design,  partitioning,  or  construction  details.  Th^^er  needs  were 
obtained  from  inter\iew's  with  Army  personnel  who  have  working  experienc^Kth  the  Army 
vehicles  to  be  affected  by  the  STTV  system. 


2.  REFERENCE  DOCUIVIENTS 

The  documents  attached  in  Appendix  A  provide  reference  material 
specified  in  this  document.  I 


3.  SYSTEM  REQUIREMENTS  /  USER  NEEDS 

3.1  System  Objectives 


ts  the  user  needs 


The  STTV  system  shall  provide  increased  situation  a'^»|qss  for  a  vehicle  commander  by 
providing  a  360®  panoramic  view  of  the  vehicle’s  sJMi^i^^"  or  the  imagery  from  a  UAV,  on 
a  helmet-mounted  display  while  inside  the  vehiql€^r  w^®standing  in  an  open  hatch.  It  shall 
also  allow  the  vehicle  commander  to  view  Bn^wstized  battle  management  infonnation 
(normally)  displayed  on  an  embedded  tastical^Mlaww  on  an  applique  tactical  display,  while 
standing  in  an  open  hatch. 

3.1.1  System  User 

The  STTV  system  shall  be  used^^^fe^ommander  of  an  armored  vehicle  to  increase  his 
situation  awttrene.ss  in  a  battlefi^t^^ftrqpnent.  The  STTV  system  is  not  intended  for  use  by 
the  vehicle  driver,  gunner,  loa^\  cP^^ngers,  although  specific  parts  of  the  system  may  be 
applied  to  this  purpose;  Ifii^jtoet-mounted  display  for  a  squad  leader  to  reconnoiter  the  area 
surrounding  the  vehicjpi^^feo  exifag  the  vehicle  for  dismounted  operations. 


iiejcommander  of  an  armored  vehicle  to  increase  his 
iroj^ient.  The  STTV  system  is  not  intended  for  use  by 
Singers,  although  specific  parts  of  the  system  may  be 


3. 1 .2  Occasion 

The  STTV  sy.stem  shall  b^fel’ble  by  the  commander  either  while  he  is  inside  the  vehicle  turret 
(buttoned  up)  or  w'hile  he  is  standing  in  the  open  hatch.  The  system  is  not  intended  to  be 
installed  in  or  on  the  vehicle’s  hull,  where  it  would  need  to  pass  through  the  vehicle’s  slip  rings. 
(Current  vehicle  slip  rings  are  not  designed  to  handle  the  additional  high  bandwidth  STTV  sensor 
data). 

When  applied  to  vehicles  in  development,  where  the  commander  may  be  located  in  the  hull  and 
the  vehicle’s  sensors  located  on  a  remotely  operated  turret  (e.g.,  on  the  FSCS,  FCV,  or  Crusader 
vehicles),  the  STTV  sen.sor  should  be  located  on  the  turret  and  the  display  used  by  the 
commander  in  the  hull.  In  these  cases  the  vehicle’s  slip  rings  can  be  designed  to  handle  the  high 
bandwidth  STTV  sensor  data. 


During  system  development  and  demonstration  the  STTV  system  may  be  mounted  on  an  Ml  13 
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hull  for  development  cost  minimization  and  expediency  purposes.  The  Ml  13  used  for  this 
purpose  should  not  have  a  turret. 


3.1.3  System  Applications 

The  STTV  sy.stem  shall  be  used  by  the  vehicle  commander  for  the  following  appP 

1 )  detection  of  terrain  hazards  in  the  vehicle’s  path  to  help  the  co: 
in  recognizing  hazardous  situations  that  could  immobilize^ 
damage  to  the  vehicle  and  its  crew, 

2)  detection  of  nearby  friendly  forces  and  environmental  stj 
movement  and  to  avoid  damage  to  the  vehicle,  frj 
structures, 

3)  detection  of  nearby  ground  threats  to  allow  protecti . 

4)  display  of  information  from  the  commander’s  ind^ 
while  standing  in  an  open  hatch  to  allow  iinm^ 
and  to  assist  in  preparing  outgoing  repo^'  .withSaj 
vehicle  . 

5)  display  of  UAV  imagery  while  inside  tb 


ions: 

.d  the  driver 
or  cause 


gynainrain  orderly 
or  man  made 


be  employed, 

\Tewer  and  tactical  display 
noftiication  of  incoming  reports 
need  to  duck  back  into  the 


hile  standing  in  an  open  hatch. 


The  STTV  system  is  not  intended  to  be  used  for|p^^|,pwirig  purposes: 

1 )  by  the  vehicle  commander  or  »unne^-^a^^ary  target  acquisition  sensor, 
by  the  vehicle  driver  as  a  dri^'^A'isT^^phancer, 

by^thc^whicle  loader  (or  an  detector  of  enemy  aircraft  or  incoming 

by  a' vehicle  crewman  as  a  w^^ilE^intenance  aid, 

by  a  vehicle  passenge#;M^:s#*'recOTnoitering  aid  prior  to  exiting  the  vehicle  for 
dismounted  operations.! 


2) 

3) 

4) 

5) 


While  the  STTV  system  is  no^esigncd  for  these  purposes,  it  is  possible  that  specific  parts  of  the 
system  may  be  applict^e^p  onb-,.ipr  more  of  these  purposes;  e.g..  a  helmet-mounted  display  for 
squad  leader  reconnoffcringiprior  to'^exiting  the  vehicle  for  dismounted  operations. 


3. 1-3.1  Driver  ,4ssistaiice;  Application 


The  following  needs  are  associated  with  the  commander  assisting  the  driver  to  avoid 
immobilization  of  the  vehicle  or  damage  to  the  vehicle  and/or  its  surroundings. 


3.1. 3.1.1  Road  Hazard  Detection 

The  STTV  system  shall  aid  the  commander  in  detecting  drop-offs  of  three  feet  or  more,  unstable 
terrain,  muddy  holes,  swampy  terrain,  or  water  obstacles  that  lie  in  the  vehicle’s  path  so  that 
damage  to  the  vehicle  or  vehicle  immobilization  may  be  avoided. 


The  driver  of  an  armored  vehicle  is  sometimes  unable  to  detect  hazardous  situations  in  the 
vehicle’s  path  because  of  his  low  vantage  point  on  the  vehicle,  or  because  his  attention  is 
diverted  to  other  locations  in  his  field  of  view.  This  can  lead  the  driver  to  encounter  the 
hazardous  obstacles,  causing  the  vehicle  to  get  .stuck  or  to  roll  over.  Such  rollovers  can  lead  to 
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injury'  of  the  crew,  or  even  death.  This  problem  is  especially  acute  while  driving  at  night  or 
when  the  driver’s  vision  aids  have  low  contrast  caused  by  smoke,  haze,  fog,  or  small  thermal 
differences  in  the  scene. 


As  a  result,  the  vehicle  commander  is  trained  to  stand  in  the  open  hatch  w%^^he  vehicle  is 
moving  and  to  help  search  for  hazardous  situations  so  that  he  can  assist  the  drfec  in  avoiding 


them.  The  commander  may  use  his  unaided  vision  in  the  daytime  and  (tMteii^ation)  night 
vision  goggles  at  night.  When  contact  with  the  enemy  is  immanent,  the^ji^nrMn^^fttaught  to 
button  up  the  hatch  for  greater  protection.  This  leaves  the  comman^^feith  onl^is  vision 
blocks  for  road  hazard  detection.  At  night,  when  approaching  the  eM^y'!^Wkdsion  blocks  are 
usually  covered  up  to  prevent  detection  of  the  vehicle’s  internal  limft^^^gh’  the  vision  blocks 
by  the  enemy.  This  leaves  the  vehicle  commander  with  no  way  w  for  road  hazards, 

except  for  using  the  commander’s  independent  target  acqui^lP^  one  exists  on  the 

vehicle.  This  sensor  usually  has  a  small  field  of  view  (10'’x7p8^^^er},  which  is  too  small  for 
efficient  road  hazard  detection.  The  STTV  system  il«|ger  SSl  of  view  can  provide  the 
commander  with  a  more  efficient  capability  for  ®>^g1rii^|detection  of  hazardous  road 
conditions.  ' 


m^lldetection  of  hazardous  road 


3.1.3.1.2  Detection  of  Nearby  Vehicles,  Dismoulted  i^ops,  and  Man  Made  Structures 


The  STTV  system  shall  aid  the  commande.^a  det^^g  nearby  armored  vehicles,  wheeled 
vehicles,  and  dismounted  troops,  as  vroljes^^^al  and  manmade  structures  such  as  trees, 
buildings,  transmission  lines,  radio  Ateni^reetcT^D  that  damage  to  nearby  objects  may  be 
avoided 


The  vehicle  commander  is  ultima^^^^piSlble  for  damage  to  the  vehicle,  and  for  damage 
done  by  the  vehicle  to  nearby  stnB,ij^,§®hicles.  and  dismounted  troops.  When  an  armored 
vehicle  is  in  motion,  the  commadeiSj^^mcd  to  be  on  constant  lookout  for  nearby  objects  such 
as  dismounted  troops,  vehicl^^trees.  transmission  line  towers,  radio  towers,  telephone  poles, 
bridges,  buildings,  an(^^%aatsl^Banmade  structures,  and  to  issue  conci,se  orders  to  the  driver 
and  ^gunner  (such  MlHT”,  “GUNNER  LEFT”)  to  avoid  encountering  these 

objects  with  the-  vcra^fe.jbjy^  turret,  or  gun.  In  Order  to  issue  the  proper  orders,  the  commander 
must  be  able  to  see  S^Stects  along  with  the  vehicle  direction  of  motion  and  the  turret-hull 
orientation. 


While  some  vehicles,  such  as  the  M1A2  Abrams  and  M2A2  Bradley,  may  have  a  turret-hull 
orientation  indicator  inside  the  turret,  the  commander  is  trained  to  avoid  using  it  because  this 
takes  his  attention  away  from  the  nearby  objects.  The  commander,  instead,  is  trained  to  stand  in 
the  open  hatch  w^here  he  can  ob.serve  directly  and  simultaneously  both  the  objects  to  be  avoided 
and  the  vehicle’s  direction  of  motion  and  turret-hull  orientation.  On  some  vehicles,  such  as  the 
Ml  A2  Abrams,  it  is  impossible  to  see  the  hull  while  standing  in  the  commander’s  open  hatch,  so 
the  commander  must  infer  the  hull’s  orientation  from  the  motion  of  the  ground  as  it  passes  by. 
The  commander  may  use  his  unaided  vision  in  the  daytime  and  (third  generation)  night  vision 
goggles  at  nighttime  for  assistance  in  detecting  nearby  objects. 


When  the  enemy  has  been  sighted,  the  commander  is  taught  to  button  up  the  hatch  for  greater 
protection.  This  leaves  the  commander  with  only  his  vision  blocks  for  nearby  object  detection. 


At  night,  when  approaching  the  enemy,  the  vision  blocks  are  usually  covered  up  to  prevent 
detection  of  the  vehicle’s  internal  lights  by  the  enemy.  This  leaves  the  commander  with  no  way 
of  searching  for  nearby  vehicles,  dismounted  troops,  buildings,  and  related  structures,  except  for 
using  the  commander’s  independent  target  acquisition  sensor,  if  one  exists  on  the  vehicle.  This 
sensor  usually  has  a  small  field  of  view  (10°x7®  or  smaller),  which  is  too  si^l  for  efficient 
searching  for  nearby  objects.  The  STTV  system  with  its  larger  field  of  view^p,  provide  the 
commander  with  a  more  efficient  capability  for  day  or  night  detection  of 


3,1 .3.1.3  Driver  Backup  Assistance 


The  STTV  system  shall  aid  the  commander  in  seeing  what  is  be^ ,,, 
direction  can  be  given  to  the  vehicle  driver  while  backing  up  in  oif^r 
or  nearby  object. 


On  most  armored  vehicles,  the  driver's  vision  is  Uniiti 
symmetric  with  the  vehicle's  centerline.  Vision  to  tMng 
turret.  Therefore,  the  driver  must  have  assistance  'from  m 
the  vehicle  to  avoid  potential  road  hazards  or  near 
commander  to  see  the  area  behind  the  vehicle  ai 
while  the  commander  is  standing  in  the  open  has 


3.1. 3.1. 4 


i;ehicle  so  that  proper 
9  a  potential  hazard 


|||i_a  fiward  180“  field-  of  regard 
obstructed  by  the  vehicle’s 
^commander  while  backing  up 
|t|iec^^"^The  STTV  system  can  help  the 
to  1^&.,the  proper  assistance  to  the  driver 
Isyhiiefte  vehicle  is  buttoned  up. 

ikation 


3.1.3.1.4.1  Field  of  Regard 


The  STTV  sensor  shall  have  a  fid 


3.1.3.1.4.2  Field  of  View 


regErd  of  360  degrees  around  the  vehicle. 


The  STTV  system  shal)^ovid^^e3Commander  the  widest  possible  field  of  view  for  the  efficient 
detection  of  road  ha^^,ltearb>^bjects,  turret-hull  orientation  determination,  and  rear  view 
vi.sualization  so  thtH^  cap'I'skie  the  proper  orders  to  the  driver. 


Experience  has  shown  thaf^^j- widest  practical  field  of  view  achievable  with  a  helmet  mounted 
display  i.s  approximately  40“x30“  for  a  single  eye.  This  limitation  is  caused  by  optical  design 
considerations  such  exit  pupil  size,  focal  length,  and  interference  with  vision  from  the  other  eye. 
Experience  also  shows  that  a  helmet-mounted  di.splay  should  provide  an  image  that  is  one-to-one 
with  the  real  world  to  avoid  problems  with  user  disorientation  due  to  the  scene  moving  faster  or 
slower  than  the  head  motion.  This  implies  that  the  sensor  field  of  view  must  be  approximately 
40“x30“  to  match  the  display  field  of  view.  These  considerations  apply  whether  or  not  the 
display  is  see-through  or  non-see-through. 


3.1.3.1.4.3  Focus 

The  STTV  sensor  shall  keep  in  focus  objects  at  a  distance  of  15  feet  to  infinity  while  operating  as 
a  commander's  driving  assistance  aid. 
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3.1. 3.1 .4.4  Detector  Wavelength 


The  STTV  sensor  shall  be  capable  of  detecting  road  signs,  drop-offs  of  3  feet  or  more,  unstable 
terrain,  muddy  holes,  swampy  terrain,  or  water  obstacles  that  lie  in  the  vehicle’s  path  in  either 
daylight  conditions  or  in  overcast  starlight  conditions  in  the  presence  of  smoke  haze. 

Experience  has  shown  that  sensors  with  a  response  in  the  8-12  pm 

performance  under  conditions  of  smoke,  haze,  and  fog.  Therefore,  the  have  a 

sensor  response  in  this  region. 

3. 1.3. 1.4.5  Latenev 


The  information  on  the  STTV  display  must  not  lag  behind  the  ipanall 


[notion. 


lixperience  lias  shown  that  a  helmet  mounted  display  sjysiejg^nsi^Hl:  of  the  sensor,  tracker, 
and  Jispias  electronics,  must  have  a  total  system  latei§^,M  60  milliseconds  in  order  to 

a\oid  pr.iMems  with  system  lag.  ’  ^ 

3. 1.3.2  (iround  Threat  Detection  Application^^ 

I'.ae  S'lTX'  vNstem  shall  aid  the  commander  ^fce^'S^ion  of  nearby  ground  threats  to  alk 
rr.see;:',  e  n'.e.iNares  to  be  employed. 


ion  of  nearby  ground  threats  to  allow 


.irmored  \ehicle  is  in  motl 


Icie  commander  is  trained  to  be  on  constant 


'r  ne.;rb>  ground  threats,  such  a?^e^giy  troops  and  vehicles.  The  commander  is  trained 
^  ..d  .iroami  the  vehicle  out  tQ[£Sifen<^^f  approximately  4{)()  yards,  for  enemy  troops  and 
•.  e:;;.  I  le  is  especially  trained  ^ilc^  crouching  troops  in  the  tree  lines  at  the  edge  of  the 
r..:;ie:!e.d  A:  times,  he  will  sh^  S^|c^^nsibility  with  the  loader  on  the  M1A2  or  the  gunner 
.•:i  :iie  Br..d.e\ .  In  this  case, ^^Uoader  will  look  in  a  180“  sector  on  his  side  of  the  vehicle,  and 
die  eo:r.:r..;nder  in  a  1 80'°'.sectof-3oitois  side  of  the  vehicle.  The  loader  will  also  be  responsible 
'.-ne  d'.reats.  and  thcSkmimaiwer  for  driver  a.ssi.stance. 

Tile  .,'mm.;nuer  may  use'M-s  unaided  vision  in  the  daytime  and  (third  generation)  night  vision 
gv'ggies  a;  nig'ni.  When  edr^ct  with  the  enemy  is  immanent,  the  commander  is  taught  to  button 
up  the  i’.aieii  for  greater  protection.  This  leaves  the  commander  with  only  his  vision  blocks  for 
nearb>  ground  threat  detection.  At  night,  when  approaching  the  enemy,  the  vision  blocks  are 
iisii.i!I>  eo\ered  up  to  prevent  detection  of  the  vehicle's  internal  lights  through  the  vision  blocks 
by  the  enemy.  This  leaves  the  vehicle  commander  with  no  way  of  searching  for  nearby  ground 
threats,  except  for  using  the  commanders  independent  target  acquisition  sensor,  if  one  exists  on 
the  vehicle.  This  sensor  usually  has  a  small  field  of  view  (10“x7“  or  smaller),  which  is  too  small 
for  efficient  detection  of  nearby  ground  threats.  The  STTV  system  with  its  larger  field  of  view 
can  provide  the  commander  with  a  more  efficient  capability  for  day  or  night  detection  of  nearby 
ground  threats. 


up  the  b. 


The  most  demanding  need  when  detecting  ground  threats  is  detecting  a  crouching  human  beint 
at  400  yards  of  the  vehicle,  especially  at  night  in  conditions  of  haze,  fog,  or  smoke. 
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3.1. 3.2.1  System  Requirements  Supporting  Ground  Threat  Detection  Application 

3.1.3.2.1.1  Field  of  Regard 


The  STTV  sensor  shall  have  a  field  of  regard  of  360  degrees  around  the  vehicle. 


3.1.3.2.1.2  Field  of  View 

The  STTV  system  shall  provide  the  commander  the  widest  possibi^fceld  of  vi^iv  for  the 
detection  of  nearby  ground  threats. 

Experience  has  shown  that  the  widest  practical  field  of  view  achi&al^e^^h  a  helmet  mounted 
display  is  approximately  40“x30°  for  a  single  eye.  This  limitaficm  ^Ici^cd  by  optical  design 
considerations  such  exit  pupil  size,  focal  length,  and  interfer^^^witlT^^ion  from  the  other  eye. 
Experience  also  shows  that  a  helmet-mounted  display  shoul^^ro^delin  image  that  is  one-to-one 


with  the  real  world  to  avoid  problems  with  user  diso^fentatic^^fee  to  the  scene  moving  faster  or 
slower  than  the  head  motion.  This  implies  that  the  view  mu.st  be  approximately 

40^x30'-''  to  match  the  display  field  of  view.  The 
display  is  see-through  or  non-see-through. 


derations  apply  w'hether  or  not  the 


3.1. 3.2.1. 3  Resolution 


The  STI'V  system  shall  be  capable  of  dSt^tina  ^Sttching  human-size  objects  at  a  distance  of 
400  yards  from  the  vehicle. 

3.1.3.2.1.4  Focus 

The  STTV  .sensor  shall  keep  in 
commander  to  detect  ground  t| 

3. 1.3.2. 1.5  Detecton 


^  ?■ 

M  . 

at  a  distance  of  15  feet  to  infinity  while  helping  the 
the  vehicle. 


The  STTV  sensor  shffl;beS;apable  of  detecting  crouching  human-size  objects  at  a  distance  of  400 
yards  from  the  vehicle’'i|if^|ther  daylight  conditions  or  in  overcast  starlight  conditions  in  the 
presence  of  smoke,  fog.  anlSaze. 


Experience  has  shown  that  sensors  with  a  response  in  the  8-12  pm  region  provide  the  be.st 
performance  under  conditions  of  smoke,  fog,  and  haze.  Therefore,  the  STTV  sen.sor  shall  have  a 
respon.se  in  this  region. 


3.1. 3.2. 1.6  Latency 

The  information  on  the  STTV  display  must  not  lag  behind  the  norma!  head  motion. 

Experience  has  shown  that  a  helmet  mounted  display  system,  consisting  of  the  sensor,  tracker, 
and  display  electronics,  must  have  a  total  system  latency  of  less  than  60  milliseconds  in  order  to 
avoid  problems  with  system  lag. 
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3,1.33  Display  of  Data  from  Commander’s  Viewer  and  Tactical  Display  While  in  Open 
Hatch' 


The  STTV  system  shall  display  information  from  the  commander’s  independent  viewer  and 
tactical  display  while  the  commander  is  standing  in  the  open  hatch  to  provid^ie  commander 
immediate  notification  of  incoming  reports  and  to  assist  him  in  preparing  ^^oing  reports 
without  the  need  to  duck  back  into  the  vehicle. 


driver  ^p;tance  or 
al  display.  This 
na^rder,  or  another 
‘  he  must  duck  back 
fe  attention  away  from 


When  the  vehicle  commander  is  standing  in  the  open  hatch  for  purpos- 
vehicle  protection,  he  is  unable  to  see  his  independent  viewer  displa 
means  that  he  can  miss  the  arrival  of  a  battalion  commander' 
vehicle's  enemy  contact  report,  on  the  tactical  display.  It  may  als' 
into  the  vehicle  to  fill  out  his  own  enemy  contact  report,  which^ 

his  duties  of  driver  assistance  and  vehicle  protection.  Somcti^^l^^^airMl  Abrams,  the  loader 
is  able  to  notify  the  vehicle  commander  of  an  incomij^&cpon-^ltnd  to  help  him  with  the 
preparation  of  new  reports.  But  there  is  no  a!tema€v^|orT^^^pmmander  than  to  duck  back 
down  into  the  turret  in  order  to  read  an  incoming  report. 

Similarly,  when  the  vehicle  commander  is  standiiM  imtt&yDen  hatch,  he  is  unable  to  see  his 
independent  thermal  viewer  display.  This  me®t^fet  {^cannot  use  easily  his  independent 
thermal  viewer  to  check  out  a  suspiciou.s  area.^|jtar^^^nd  may  miss  an  important  opportunity 
to  spot  the  enemy  first  before  he  is  spotte 


The  following  needs  are  associated  of  information  from  the  commander’s 

independent  thermal  viewer  and  tactical  dSfiy,  while  standing  in  an  open  hatch. 


3.1.3.3.1  FUR  Sensor  Display 

The  STTV  display  shall  be 
generation  FLIR,  such^Sfe^Cl 
Bradley  vehicle. 


e  of  di.splaying  the  real  time  imagery  from  an  HTI  second 
the  MI  A2  Abrams  SEP  vehicle,  or  the  CIV  on  the  M2A3 


The  HTI  second  gener^^p;,FLIR  is  the  standard  FLIR  that  w’ill  be  used  on  all  future  armored 
vehicles  and  amiored  vel®|: upgrades.  While  some  vehicles  may  still  ase  a  first  generation 
FLIR.  or  no  FLIR,  at  this  time,  nearly  all  vehicles  will  be  upgraded  to  the  HTI  second  generation 
FLIR  standard.  Therefore,  by  the  time  the  STTV  system  is  available,  most  FLIR’s  will  be  HTI 


second  generation  FLIR’s. 


3.1.3.3.1.1  FLIR  Display  Resolution 

The  STTV  display  shall  be  capable  of  displaying  all  or  part  of  the  HTI  second  generation  FLIR 
1315x480  pixel  imagery  at  30  frames/scc.  Modified  RS-170  timing  w'iil  be  used. 

3.1.3.3.1.2  FLIR  Display  Color 

The  STTV  display  shall  be  capable  of  displaying  the  monochrome  imagery  from  an  HTI  second 
generation  FLIR  sensor. 
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3.1.3.3.2  Tactical  Display 


The  STTV  display  shall  be  capable  of  displaying  the  tactical  information,  such  as  reports  and 
color  maps,  from  an  embedded  vehicle  FBCB2  tactical  display  or  from  a  TRW  Applique+ 
display.  A 


3.1.3.3.2.1  Tactical  Display  Resolution 


The  STTV  display  shall  be  capable  of  displaying  all  of  the  800x600  data  of  |ife  tactical 
display  at  a  50  Hz  refresh  rate.  XVGA  timing  will  be  used. 


3.1.3.3.2.2  Tactical  Display  Color 


The  STTV  display  shall  be  capable  of  displaying  the  colorfl^fed^^^splayed  an  embedded 


vehicle  FBCB2  tactical  display  or  from  a  TRW  Applique+^ftlay: 


3. 1 .3.4  Display  of  U A  V  Information 


The  STTV  system  shall  be  capable  of  displaying^A^^^ggery  on  the  commander’s  helmet- 
mounted  display  while  inside  the  vehicle  or  whil-^^fcding  Wan  open  hatch. 


3.1. 3.4.1  RF  Data  Link  Interface 


The  STTV  system  shall  provide  an  K^^eiV^Igpable  of  receiving  the  real  time  sensor  data 
from  a  UAV. 


3.1.3.4.2  UAV  Display  Resolutip 


/«%  ww 


The  STTV  display  shall  b#^^ipabie^f  displaying  the  real-time  640x480  pixel  imagerj^ 
information  from  a  U^^|3"^^pe.s/sec.  Modified  RS-170  timing  will  be  used.  The  STTV 
display  shall  also  ^^splaf^e  annotated  still  images  received  over  the  FBCB2  tactical 

data  network. 

3.1.3.4.3  UAV  Display Biir 


The  STTV  display  .shall  be  capable  of  displaying  the  real-time  monochrome  imagery  from  a 
UAV  sensor  or  the  annotated  still  images  received  over  the  FBCB2  tactical  data  network. 


3.2  Vehicle  Compatibility 

The  STTV  system  shall  be  capable  of  operating  on  multiple  types  of  armored  vehicles.  Multiple 
vehicle  compatibility  shall  be  achieved  by  a  modular  design  which  permits  tailoring  the  STTV 
system  to  the  vehicle’s  needs:  e.g.,  by  .selecting  a  subset  of  the  modules  for  a  fielded  vehicle 
needing  only  a  helmet-mounted  display  or  by  selecting  the  complete  set  of  sensor,  processor,  and 
UAV  imagery  receiver  modules  for  a  new  vehicle  in  development. 
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3.2.1  Vehicle  Types  Supported 


The  STTV  system  shall  be  capable  of  operating  on  the  following  vehicle  types  in  the  Army 
inventory  or  currently  in  development: 

1)  MlAl  Abrams 

2)  M1A2  Abrams 

3)  M1A2  SEP  Abrams 

4)  M2A2  ODS  Bradley  Infantry  Vehicle 

5)  M2A3  Bradley  Infantry  Vehicle  'W?!,  ^ 

6)  M3A2  ODS  Bradley  Cavalry  Vehicle 

7)  M3  A3  Bradley  Cavalry  Vehicle  * 

8)  M 1 1 3  Infantry  Vehicle  P' 

9)  Ml 09  Paladin  (Howitzer) 

10)  M88A2  Hercules  (Armored  Recovery  Vehicle) 

1 1 )  Wolverine  (Heavy  Assault  Bridge)  ^ 

12)  LAV-25  (Light  Armored  Vehicle) 

13)  AAAV  (Advanced  Amphibious  Armored 

1 4)  XM200 1  Crusader  (Howitzer) 

15)  FSCS  /  Tracer  (Future  Scout  and  Cava^Sy^^f 

1 6)  XM8  AGS  (Armored  Gun  System) 

17)  XM4  C“V  (Command  and  Cmtrol^^ici^^' 

18)  FCV  (Future  Combat  VehicI#^^'^!^ 

19)  FIV  (Future  Infantry  Vehi4^, 


3-2.2  Vehicle-Related  System  Re^ulioeiri^l 


3.2.2. 1  Sensor  Mounting  LocatiwaZ 


The  STTV  sensor  shall Jb^^nuOTtod  on  the  vehicle  turret.  The  STTV  sensor  should  not  obstruct 
the  operation  of  exi.si^^^uipmej|>on  the  turret,  such  as  sensors,  machine  guns,  or  missile 
launchers.  The  STTi^en|^yhoula'not  be  higher  than  the  top  of  the  open  hatch  on  the  vehicle. 
The  STTV  sensor  m^^g^ist  of  a  single  package  capable  of  360®  operation,  if  possible,  but 
shall  be  capable  of  bei^^&grated  into  smaller  units  having  smaller  fields  of  view  and  placed  at 
multiple  locations  on  the  ou®de  of  the  turret,  if  required. 


3.2.2.2  Display  Electronics  Location 

The  STTV  di.splay  electronics  shall  be  mounted  inside  the  vehicle  turret.  The  STTV  display 
electronics  shall  not  interfere  with  the  operation  of  other  functions  within  the  turret. 

3.2.2.3  Display  Controls  Acces-sibility 

The  STTV  display  controls  shall  be  accessible  to  the  commander  while  he  is  seated  inside  the 
vehicle  or  wLile  he  is  standing  in  the  open  hatch. 


3.2.2.4  Display  Mounting  on  Helmet 
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The  STTV  display  shall  be  mountable  on  a  standard  DH-132  Combat  Vehicle  Crew  (CVC) 
helmet  per  MIL-H-441 17.  The  display  shall  be  mountable  in  such  a  manner  as  to  allow  either  left 
eye  or  right  eye  operation.  The  display  shall  have  two  positions  on  the  helmet:  an  operating 
position  and  a  stow  position.  In  the  stow  position  the  display  shall  be  tumd  off.  In  the 
operating  position  the  display  mount  shall  permit  both  a  look  over  and  a  looi^&ider  mode  of 
operation.  The  display  mount  shall  not  interfere  with  the  use  of: 

1 )  personal  eyeglasses, 

2)  sand,  wind  ,  and  dust  goggles,  and  the  storage  of  these  gi 
helmet, 

3)  NBC  mask,  - 

4)  head  rests  while  using  any  sights  inside  the  vehicle, 

5)  moving  through  the  open  hatch  in  either  direction. 


3.2.2.5  Display  Cable 


on  th^fep  of  the 


The  STTV  display  unit  shall  have  a  cable  length  and  flexmi^^dhat  permits  normal  motion  of  the 

hi^ia^aif^pen  hatch.  Normal  motion  shall 
include  sitting  down,  standing  on  the  seat,  turni:^tn  arTyftrection,  and  facing  in  any  direction. 


commander  while  inside  the  vehicle  or  w'hile  s 
include  sitting  down,  standing  on  the  seat,  tur 
including  rearward,  while  standing  on  the  seat. 

3-2,2.6  Quick  Disconnect  Connector^* 


The  STTV  display  cable  shall  have  a  qujic3^:,dis(;^nncct  connector  that  allows  rapid  egress  from 


fitEaximum  separation  force  of  the  quick  disconnect 


the  vehicle  without  pulling  on  a  lan>'| 
connector  shall  be  1 0  lbs  or  less. 

3.2.2J  Ivight  Leakage 


Light  leakage  aroundj^''hc!rte|T-mpunted  display  shall  be  undetectable  by  the  naked  eye  at 
ranges  beyond  10  m»fs  ita|[  undSteliable  with  AN/PVS-5  or  AN/PVS-7  night  vision  goggles 
bevond  25  meters. 


3.3  Composite  STTV  System  Performance  Requirements 


The  STTV  system  shall  include  a  sensor  function  and  a  display  function.  The  composite 
performance  requirements  for  these  functions  that  enable  them  to  support  all  the  needs  identified 
above  are  listed  in  the  following  subsections. 


3.3.1  Sensor  Performance 

The  STTV  sensor  shall  have  the  following  capabilities: 

•  360*^  field  of  regard 

•  40'’x30^'  FOV 

•  in  focus  >  15  feet 

•  8-12  pm  wavelength 

•  >170'’ /sec  slew  rate. 
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3.3.2  Display  Performance 

The  STTV  display  shall  have  the  following  capabilities: 

•  monocular 

•  non  see-through 

•  800x600  pixels 

•  40°x30°  FOV 

•  color. 


3.3.3  System  Performance 

The  STTV  system  shall  have  the  following  capabilities: 

•  able  to  detect  human  targets  at  400  yards 

•  <  66  msec  system  latency 

•  slew  to  cue  capability. 


3.3,4  Human  Factors  Requirements 

The  STTV  system  shall  meet  the  followinc  human 
*  no  illness  caused  by  imagery  motion  oj 


controls  located  on  the  vehicle  in  e: 
no  hazardous  materials  or  dan^iPqps  ^ 
helmet  with  display  causes  ]^4isd 


3.4  Acronyms 

CITV 

CIV 

cvc 

FBCB2 

FCV 

FLIR 

FOR 

FOV 

FSCS 

HTI 

HMD 

Hz 

ICCD 

IHAS 

IVIS 

NBC 

NFOV 

ODS 

SEP 

SVGA 

STTV 


(jt  ?»%train  on  user’s  he 


dent  Thermal  View'er 
dent  Viewer 


CommanderpJ 
Comman^' .. 

Comba^ehicleTTew 

Battib  Command,  Brigade  and  Below 
m^lContRat 'Vehicle 
)rjyi&d  l,a>oking  Infra  Red 
of  Regard 
Fiefd^f  View- 

Future  Scout  and  Cavalry  System 
Horizontal  Technology  Integration 
Helmet  Mounted  Display 
Hertz 

Intensified  Charge  Coupled  Device 
Integrated 'Helmet  Assembly  Subsystem 
inter  Vehicular  Information  System 
Nuclear  Biological  Chemical 
Narrow  Field  of  View 
Operation  Desert  Storm 
System  Enhancement  Program 
Super  Video  Graphics  Adapter 
See-Through  Tank  Visualization 
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Appendix  B 

STTV  Prototype  Development  Specification 
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1.  SCOPE 


This  specification  establi.shes  the  design  for  a  See  Though  Tank  Visualization  System  (STTV). 
The  STTV  system  shall  provide  increased  situation  awareness  for  a  vehicle  commander  by 
providing  a  360°  panoramic  view  of  the  vehicle’s  surroundings,  or  the  imagery  from  a  UAV,  on 
the  Mounted  Warrior  helmet-mounted  display  while  inside  the  vehicle  or  wMte  standing  in  an 
open  hatch.  It  .shall  also  allow  the  vehicle  commander  to  view  the  digitized  l^w,  management 
information  received  from  an  integrated  vehicle  or  applique  system  in  an  open 

hatch.  The  STTV  system  shall  be  capable  of  operating  on  multiple  vehffife  type^fflulti-vehicle 
compatibility  .shall  be  achieved  by  a  modular  design  which  permits  ta^^g  the  S'Cy  system  to 
the  vehicle’s  needs;  e.g.,  by  selecting  a  subset  of  the  modules  for  a^^Jid^^i^cle  needing  only  a 
helmet-mounted  display  or  by  selecting  the  complete  set  of  sens^p^^ss^^  and  UAV  imagery 
receiver  modules  for  a  new  vehicle  in  development.  f 


The  design  specified  in  this  document  is  intended  accurate  description  of  a 

demonstration  system  that  shows  the  feasibilky  oi^keetinfUfee  user’s  STTV  system 
requirements,  but  that  u.ses  surrogate  sensors  and  hfeiet.nSk^lk,  displays  of  low'cr  performance 
due  to  funding  constraints.  Similarly,  due  to  the  unaViifcibili^of  an  MJA2  Abrams  or  M2A2 
Bradley,  a  surrogate  Mi  13  demonstration  vehicle^iiJ  belied  that  lacks  a  second  generation 
FLIR  sensor  and  tactical  display.  Therefore,  §fic%btbtfaces  to  these  functions  will  not  be 
provided. 


Figure  1.1  See-Through  Tank  Visualization  System  Semsor  Unit 
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Figure  1.2  See-TWPu 


REFERENCE  DOCUjpEN 


nk  Visualization  System  Fields  of  View 


The  following  docm^^^J'oi^m;|part  of  this  specification  to  the  extent  specified  herein.  In  the 
event  of  a  confl^'  b^sieen  nte  documents  referenced  herein  and  the  contents  of  this 
specification,  the^^gcj^of  this  specification  shall  be  considered  the  superseding  requirement. 


2.1  Government  Spe^feations 


System  Requirements  Specification  for  a  See-Through  Tank  Visualization  System, 
Honeywell  Inc,  6  November  1998 


2.2  Honeywell  Specifications 

Land  Warrior  IHAS  Specification,  Honeywell  Inc,  12  January  1998 
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3.  Requirements 
3.1  System  Description 


The  See  Though  Tank  Visualization  System  shal 
in  Figure  3.1: 


consist  of  the  following  components  as  shown 


a) 

b) 

c) 

d) 

e) 

f) 

s) 

h) 

i) 

j) 

k) 

l) 


panoramic  sensor  unit 

gimbaled  IR  sensor  unit 

image  processor 

power  supply 

RS-232  switch 

developer’s  control  panel 

helmet  assembly 

helmet-mounted  display 

display  control  module 

head  tracker  inertial  measurement  unit 

head  tracker  signal  processor 

commanders  conro!  panel 


m)  squad  leader’s  joystick  control 


Panoramic  Sensor  Unit 
(PSU) 


^  GIMBALED  L . . . 

^  SEKSOR  te  RS~i7£ 
UNIT  Nf- 

(Gsu)  r 


Squad  teader^s  Display 


Helmet  : 
Display 


Non -deliverable 
future  option 


Figure  3.1  See-Through  Tank  Vi.sualization  System  Components 
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3.2  STTV  System  Module  Specifications 
3.2.1  Panoramic  Staring  Sensor  Unit 


The  panoramic  staring  sensor  unit  shall  provide  the  vehicle  commander  a  low  latency  360"  view 
of  the  vehicle’s  surroundings  in  either  day  or  night  illumination  conditions.  T^sensor  unit  shall 
consist  of  eight  monochrome  visible  CCD  cameras  with  each  camera  having  6^p494  pixels  and 
a  6  mm  autoiris  lens  with  a  field  of  view  of  x  42°(V).  The  came^^^^M^^  arranged  to 

provide  360"  panoramic  field  of  view  wherein  all  the  cameras  have  fife  point  to 

eliminate  parallax  between  adjacent  cameras.  Each  camera  shall  prd^fe  ^ 
view  of  45"  encoded  into  512  pixels.  The  vertical  field  of  view  shalJLbe^^^ilted  down  7"  from 
the  horizontal  (i.e,  14"  above  the  horizontal  and  28°  below  the  Jli^SBAal T*^he  cameras  shall 


laminated  wdthin  the 
ises  motion  blur.  The 
allow  operation  over  a 
a^^-232  interface  that  allows 
^panoramic  staring  sensor  shall 
without  obstructing  other  turret 


have  an  interlaced  RS-170  output  with  all  the  pixels  in  the 
same  integration  time  to  eliminate  image  offset  between  fi. 
cameras  shall  have  automatic  gain  control  circuits  and  auti 
wide  range  of  ambient  illumination.  The  camera.s  sha 
changing  the  camera  integration  time  and  gain  !^|n^.s 
provide  an  unobstructed  360®  view  of  the  vehicle’s  si^ 
functions  such  as  FLIR  .sensors  and  machine  gup||||f^h?^^^©ramic  staaring  sensor  shall  allow 
the  detection  of  terrain  obstacles  and  hazards  in  tp^^^icjs  path,  such  as  gullies  and  drop-offs, 
and  the  detection  of  human-size  threats  at  a  di^^»jpf  Ri  vards. 


3.2.2  Gimbaled  IR  Sen.sor  Unit 

The  gimbaled  IR  sensor  unit  shS^ 
vehicle’s  surroundings  in  either  day  ol 
latency.  The  sensor  shall  consist 
with  a  horizontal  field  of  view  cA5, 
mounted  on  a  gimbal  that 
gimbal  controller  shall  pci^il^ca 
the  azimuth  and  eleyaiion 

j  1  j  •  .1-  ''^4 

and  hazards  in  th 


yards.  The  .sen: 
inches  or  less  w 
used  on  an  M1A2 
vehicle. 


commander  a  higher  resolution  view  of  the 
ilfimination  conditions  at  the  expense  of  increased 
:40  pixel  or  greater  microbolometer  LWIR  sensor 
a  vertical  field  of  view  of  1 1.5°.  The  sen.sor  shall  be 
ig  in  both  the  azimuth  and  elevation  directions.  The 


ed  scanning  with  a  slew  rate  of  1 70°  per  second  in  both 
pns.  The  sensor  shall  permit  the  detection  of  terrain  obstacles 
I's  paflTknd  the  detection  of  human-size  threats  at  a  distance  of  500 
mbal  shall  have  a  diameter  of  12  inches  or  le.ss  and  a  height  of  16 
ted  on  the  vehicle  turret.  Tliis  unit  may  be  replaced  by  the  CITV  when 
or  by  the  CIV  when  used  on  the  M2A3  Bradley  or  M3A2  Scout 


3.2.3  Image  Proce.ssor  Unit 

The  image  processor  unit  shall  accept  real-time  monochromatic  imagery  data  from  the  STTV 
panoramic  staring  sensor  modules,  and  the  STTV  high  resolution  scanned  sensor  unit,  and  shall 
provide  processed  imagery  to  the  helmet-mounted  display  unit.  The  image  prcxessor  unit  shall 
be  capable  of  performing  the  following  image  proces.sing  functions  without  reconfiguration: 
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1 )  Controlling  the  panning  and  tilting  of  the  360°  FOV  panoramic  staring  sensor  unit  to 
produce  a  visible  TV  image  stream  in  the  direction  of  the  commander’s  current  line  of 
sight.  This  involves  translating  the  head  tracker  output  signal  into  a  current  line  of 
sight  direction,  selecting  the  two  camera  outputs  nearest  the  current  line  of  sight 
direction,  warping  their  image  streams  to  the  new  line  of  direction,  mo.saicing  the 
resulting  image  streams  to  create  a  single  new  image  stream,  and  ^^ding  the  image 
junction  in  the  new  image  stream  to  form  a  seamless  image  in  the  ci^iKt  line  of  sight 
direction. 

Controlling  the  panning  and  tilting  of  the  gimbaled  IR  se^w'unit  topiiliuce  an  IR 
image  stream  in  the  direction  of  the  commander’s  current  lm|.^^ight. 


2) 

3)  Aligning  the  lines  of  sight  of  the  visible  and  IR  .sens; 


4) 

5) 


6) 

7) 

8) 

9) 

10) 


11) 

12) 


)  »|iead  tracker  line  of 
•o  azimuth  relative  to 


sight  by  mapping  their  forward-most  line  of  sight  (zl 

the  turret)  to  the  head  tracker  line  of  sight  when  the  hlad^ac^fer  is  being  aimed  to  the 
front  of  the  turret  (zero  degrees  azimuth). 

Black  hot  /  white  hot  selection  of  the  IR  image: 

Alignment  and  superposition  of  the  nac^w 


field  of  view  visible  TV  imagery'  to  prSdup; 
resolution  in  the  foveal  region. 


Electronic  zoom  (in  and  out  from  the 
Reticle  size  control  (lareer  and  sm,^, 
shape  be  easily  changeable  by  modffy'' 


viw  IR  imagery  with  the  wide 
itisensor  fused  image  with  higher 


^agnmi&tion)  of  the  displayed  imagery, 
ter  'fmpi  -a  standard  size  reticle).  The  reticle 
tjR  biSnapped  software  file, 
revmjpfrly  designated  by  the  contents  of  a  reticle 


Moving  target  tracking  of  tut  o 
box. 

Rear  view  mode,  wherelgyh^kth^pfMght  of  the  sensor(s)  currently  being  displayed 
is  immediately  switchedmiihe  dilution  180°  in  back  of  the  current  head  position  to 


hedi-tin  a  non-left/riaht  inverted  fashion. 


show  the  imagery  toward) 

Slew-to-cue  mode,  thei'hser  can  immediately  slew  the  di.splayed  imagery  to 

the  target  being  track&^fc^tl’^lR  sensor  instead  of  continuing  to  look  in  the  direction 
of  the  current  heOi^rpeiSitipj^'e.,  the  display  of  the  target  is  decoupled  from  the  head 
tracker  positioai^^us  mode  simulates  a  vehicle’s  turret  being  rotated  by  the  gunner  to 


a  new 

Re-desipiaiK 
box 

the  mov^m^ 
Second  gei^ 


13) 


fevTOilly  selected  by  the  commander. 

pf  thSfrarget  being  tracked,  whereby  reducing  the  size  of  the  target 
ifgei  is  being  tracked  and  re-.selecting  the  tracking  function  will  cau.se 
get  tracker  to  track  the  new  features  in  the  smaller  reticle  box. 
tfon  FLIR  image  warping,  whereby  the  processor  will  warp  the  1:1.5 
pixel  ratio  second  generation  FLIR  imagery  applied  to  the  IR  sensor  input  to  a  I:! 
pixel  ratio  required  by  a  commercial  AMEL  display.  This  will  allow  the  second 
generation  FLIR  imagery  to  be  displayed  on  a  commercial  display  without  image 
distortion  in  the  horizontal  direction.  And,  finally. 

Control  panel  integration,  whereby  the  control  signals  produced  by  the  commander’s 
control  panel  are  mapped  into  the  software  commands  for  controlling  the  sensor  and 
processor  functions. 
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The  image  processor  unit  shall  fit  into  a  6U  VME  chassis.  It  shall  have  the  following  image  data 
inputs  and  outputs: 

a)  eight  RS-170  inputs  for  imagery  from  the  panoramic 
( monochrome  659x494  pixels  at  30  frames  per  .second). 


staring  ensor  modules 


sensor  unit 

iii 

Wensor  unit 


fed  display,  and 
or  alternate  helmet- 


h)  one  RS-170  input  for  imagery  from  the  scanned 
1  monochrome  320x240  pixels  at  30  frames  per  second), 
c)  one  RS-170  input  for  imageiy-  from  an  HTI  second  gel 
{ monochrome  1 3 15x480  pixels  at  30  frames  per  secon^^^^^ 
d  1  one  RS- !  70  output  for  imagery  to  the  commander’s  hdUfi'et-tnQii 


e  ime  RS- 1 70  output  for  imagery  to  a  tape  recorder, 
mounted  display. 


:c  processor  unit  shall  accept  an  RS-232'.,eont 
rdlou's  the  system  control  modes  : 
nc lection  of  the  imagery  source, 
sciection  of  the  display  mode: 

1 1  cither  a  head  tracker  modelcin  iMichdhe  user  can  read  out  a  subset  of  the 
360''  panoramic  database  using  a  head  tracker  or  manual 

joystick  for  a  pap  an (ffilponi^^or 


bm  the  developer’s  control 


.) 


mat  ion  of  a  target 


.r.e  kc 
•o_\  v.u 

Mg; 

Tiic 
the 


one  of  four  maimUy  sS^fed  views  of  the  data  in  the  image  database,  and 
^sIei!^|^;^u«node. 

cc'.sor  unit  shall  also  aSep^j^^RS-232  control  input  from  the  commander's  head 
proces.sor  unit  and^^sfetind  kS-232  control  input  from  a  squad  leader’s  manual 
aiii'u  the  seicctioiJl&f’Jie  field  of  view  corresponding  to  the  user’s  desired  line  of 


;.()S 


processor 


ed  sensor  to  s 


an  RS-232  control  output  to  the  gimbaled  sensor  that  allows 
in  r^bnse  to  head  motion  and  to  track  moving  objects. 


3.2.4  Power  Supply  Unit 


The  power  supply  unit  shall  generate  all  the  voltages  required  by  the  STTV  system  components. 
The  power  supply  unit  shall  be  powered  by  1 10  VAC  w?hich,  in  turn,  shall  be  supplied  by  a  1 10 
V.AC  power-  inverter  that  is  capable  of  operating  from  a  28  volt  vehicle  power  source  per  MIL- 
vSTD-1275.  (Note:  This  requires  the  power  inverter  to  operate  over  the  range  of  16VDC  to  30 
VDC). 


PAGE  1 

RHV 

- 

3.2.5  RS-232  Switch 


Sensor  and  Guidance  Products  Division 

Honeywell 

B  MINNEAPOLIS,  MN 
ST.  PETERSBURG,  FL 


FSCM  94580 


FSCM  09128 


SPECIFICATION  NO. 


DSXXXXX-Ol 


An  RS-232  .switching  unit  slial!  be  provided  that  allows  the  developer’s  control  pane!  to  send 
control  commands  to  each  of  the  eight  CCD  cameras  via  an  RS-232  link. 


3.2.6  Developer^s  Control  Panel 

A  developer’s  control  panel  shall  be  provided  in  the  form  of  a  portabh 
controlling  the  image  proces.sor  via  an  RS-232  link  u.sing  a  keyboard  al 
developer's  control  panel  shall  also  permit  controling  the  camera  settin^,dui 
via  an  RS-232  link. 

3.2.7  Helmet  A.ssemblv 


C  that  enables 
mouse.  The 
^development 


and  liner  (MIL-H- 
When  u.sed  with  a 


cf 

||ilet. 

nioimted  on  the  side  of  the 
helmet  to  mount  the  tracker 
Packer  and  one  foot  of  intercom 
Wlie  no  more  than  TBD  mm  from 


Warrior  compatible  display  having  the 


The  helmet  assembly  .shall  consist  of  a  standard  DH-I3 
441 1 7A),  with  a  standard  M-138/G  microphone  and  MK- 
head  tracker,  the  helmet  assembly  shall  include  a  head  trac 
helmet  opposite  to  the  display.  No  new  holes  shall  be  rec) 
sensor.  The  total  weight  of  the  helmet  as.semblw-wiA. 
cable  shall  be  less  than  TBD  pounds.  The  center  ot  grMiJyif 
the  traaion  in  the  front/back  and  side/sidc  dircctio: 


3.2.8  Helmet-Mounted  Display 

The  helmet-mounted  display  .shall 
following  features: 

a)  monocular,  either  left 

b)  direct  view,  allowing  all  of 

1 )  directly  in 

2)  look-overt  . 

3)  look-uMefi&pabffity, 

a)  640x480  pixels, 

b)  26“xl9°^M^f 

c)  monoc 

d)  exit  pppi  :-:'25  mm, 

e)  eye  rcIiH  5  mm. 


The  helmet-mounted  display  shall  also  be  capable  of  di.splaying  monochromatic  640x480  pixel 
data  from  a  monochrome  VGA  or  RS-170  compatible  source  when  operated  as  pail  of  a  Land 
Warrior  IHAS  system. 

Light  leakage  around  the  helmet-mounted  display  shall  be  undetectable  by  the  naked  eye  at 
ranges  beyond  10  meters  and  undetectable  with  AN/PV$-5  or  AN/PVS-7  night  vision  goggles 
beyond  25  meters. 


iSfollowing  modes; 
tlfesieve. 
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The  helmet-mounted  display  unit  shall  be  mountable  on  a  standard  combat  vehicle  crew  (CVC) 
helmet  without  requiring  any  additional  holes  in  the  helmet  and  using  no  special  tools.  The 
display  shall  be  mountable  in  such  a  manner  as  to  allow  either  left  eye  or  right  eye  operation. 
The  helmet-mounted  display  shall  cause  no  interference  with  wearing  sand,  wind,  and  dust 
goggles  and  no  interference  with  the  storing  of  these  gaggles  on  top  of  the  helpiet.  The  helmet- 
mounted  di.splay  shall  have  a  stow  position  that  causes  no  interference  when  ^^user  is  viewing 
other  displays  while  inside  the  turret  or  while  moving  through  the  hatch.  Whe^^  display  is  in 
the  stow  position  it  shall  be  turned  off. 


The  helmet- mounted  di.splay  unit  shall  have  a  cable  six  feet  long  froi^M^ay  eled^nics  to  the 
helmet,  with  a  clip  to  attach  to  the  users  clothing.  The  cable  quick  disconnect 

connector  (QDC)  between  the  cable  clip  and  the  display  el&tr^^^sAat  has  a  maximum 
separation  force  of  10  lbs.  The  QDC  shall  allow  the  user  tc#e^s^Rm  the  vehicle  in  an 
emergency  without  pulling  on  a  lanyard. 


The  total  weiaht  of  the  helmet  assembly  unit  with,Aelrr#lKiount^<lisplav.  tracker  sensor,  one 
foot  of  intercom  cable,  and  one  foot  of  display  cam^Jiau'^^gh  less  than  TBD  pounds.  The 
center  of  gravity  of  the  helmet  a,s,sembly  with  helmet-^^^ied  msplay  attached  shall  lie  no  more 
than  TBD  mm  from  the  traaion  in  the  front/back  ^fcdje/sfetlirections. 


3.2,9  Display  Control  Module 


The  display  control  module  shall  ac(^^ea]^M®;Jmagery  data  from  the  image  processor  and 
provide  AMEL  drive  signals  to  tho^m^^©un^#display  unit.  It  shall  have  the  following  data 
and  control  inputs  and  outputs: 

a)  data  inputs: 

1 )  monochrome  6t0x4S0.VBA  input, 

2)  RS-170input|  , 

b)  data  outputs:  f  ^  :  45^;- ' 

1 )  monochrome  video  aata  to  AMEL  display  control  inputs: 

c)  control 

I  )^/^S(Selcct 
2^|brig|^ss  adjust 

3)  ct^^t  adjust. 


3.2.10  Head  Tracker  Inertial  Mea.surenient  Unit 


The  head  tracker  shall  consist  of  an  Intersense  IS-300  head  tracker  with  inertial  measurement 
unit  and  .signal  processor.  The  inertia!  measurement  unit  shall  be  mounted  on  a  standard  DH-132 
CVC  helmet  with  a  standard  M-138/G  microphone  and  MK-1697/G  headset. 


3.2.11  Head  Tracker  Signal  Processor 
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The  head  tracker  signal  processor  shall  be  an  Intersense  IS-300  signal  processor  with  integral 
power  supply..  The  tracker  shall  have  an  angular  accuracy  of  TBD  radians.  The  tracker  shall 
have  a  maximum  latency  of  15  milliseconds  as  measured  from  the  time  to  make  a  new 
measurement  to  the  time  that  a  message  containing  the  measurement  data  is  received  by  the 
using  electronics.  The  tracker  shall  be  capable  of  operating  in  or  on  an  armore^.  vehicle  such  as  a 
tank  or  infantry  vehicle. 

3.2.12  Commander’s  Control  Panel 


The  commander's  control  panel  shall  have  the  following  user  controls 


sensor  select  (rotary  swit 

1 )  Visible  sensor  only 

2)  IR  sensor  only 
.s  I  Visible  and  IR  sensors  fused 
4  )  FLIR  sensor 

5)  tactical  display  (IVIS)  (this  cotaro!  ^^j.sharfT>c  provided,  but  the  tactical 
display  interface  shall  not  b^i^plpnfe^^  in  the  Ml  13  demonstration 
system), 

6)  L’.>\-V  imagery  (this  control  ipi^ 


(fShairw  provided,  but  the  UAV  imagery 
interface  shall  not  be  implenieited  A«ti^,Ml  13  demonstration  system). 
Panning  mode  .select  (toggle  switcl^"'  '  "' 


!  I  Head  tracker  panning 
2i  Joystick  panning  ' 

ZiHnn  mode  .select  (tog| 

!  I  Head  tracker  panlntlji 
2)  Joystick  pannine 

Rw'ar  \  icw  mode  selec^PpMig  loaded  toggle  switch): 

1  !  Direct  view 
2 !  Rear  '•'iew^ 

tracker  /Aiw  tra'cfeef  mode  (rotary  push  button): 
Target  and  track 

/Return  to  headlrack  mode 


areei 


hi 

i ) 


-I  :  . 

SIew4^cuc_^^nction  (rotary  push  button): 

Slew  turret?;-.. 

Return  to  target  backing  mode. 

W'hitc/black  hot  select  for  IR  and  FLIR  sensor  (rotary  push  button): 

1 )  white  hot 

2)  black  hot 


The  sensor/display  control  unit  shall  be  mounted  inside  the  turret  in  a  position  that  allows  the 
user  to  reach  the  controls  either  while  standing  in  the  hatch  or  while  sitting  in  the  closed  turret. 
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A  joy  stick  shall  be  provided  for  the  squad  leader  to  enable  panning  through  the  imagery  from 
the  panoramic  staring  sensor  unit.  The  joy  stick  may  also  be  used  as  cursor  when  displaying 
tactical  display  data  to  allow  creating  spot  reports.  (This  cursor  capability  shall  not  be  required  in 
the  M 1 1 3  demonstration  system).  * 

3.3  System  Interfaces 


3.3.1  Internal  System  Interfaces 

Interna!  sy.stem  interfaces  are  shown  schematically  in  Figure  3. 

3.3.1.1  Sensor  -  Image  Processor  Interfaces 


The  system  shall  have  two  sensor  -  processor  interfaces:  ^ 
interface,  and  2)  a  panoramic  sensor  video  interfac^,  ^ 

3.3.1. 1.1  Gimbaled  Semsor  Video  and  RS-232  Interim 


ed  sensor  video  /  RS-232 


The  gimbaled  sen.sor  shall  have  a  video  and  JS-23l||imterface  to  the  processor.  The  video 
interface  shall  consist  of  a  10  foot  long  ^Hfeasseiiroly  that  carries  RS-170A  composite 
interlaced  video.  The  RS-232  interface  shatt^ryi^muth  and  elevation  .slewing  signals  to  the 
gimbal  from  the  processor  and  azimu^smcF^^toon  gimbal  position  signals  from  the  gimbal  to 
the  processor. 


3.3.1.1.2  Panoramic  Sen.sor  Video  fiitiiirface' 


The  panoramic  sensor  shall  haNfeairoes,  interface  to  the  processor.  The  video  interface  shall 


consist  of  a  10  foot  long  cabM3a.^^^^lhal  carries  RS-170A  interlaced  composite  video  signals 
from  the  eight  visible  T\'^^ner^^  the  processor.  All  cameras  shall  be  synchronized  by 
common  horizontal  «feeiT^ft^nc  signals  to  produce  pixel-synchronous  video  outputs. 


3.3.1.2  Sen.sor^^^>^’'SuppIy  Interface 

The  sensor  -  power  s^fo.interface  shall  consist  of  two  10  foot  long  cable  assemblies.  One 
cable  assembly  shall  car^^ power  to  the  panoramic  sensor  unit.  The  other  cable  assembly  shall 
cany?  power  to  the  gimbaled  sensor  unit. 


3.3.1.3  Sen.sor  -  RS-232  Switch  Interface 


The  sensor  -  RS-232  switch  interface  shall  consist  of  one  10  foot  long  cable  assembly  that 
carries  RS-232  control  signals.from  the  developer’s  control  panel  to  the  eight  cameras  in  the 
panoramic  sensor  unit. 
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3.3.1.4  Image  Processor  -  Display  Interfaces 

The  image  processor  shall  provide  video  outputs  to  the  Honeywell  Land  Warrior  helmet 
mounted  di.splay  and  to  a  standard  TV  monitor. 


3.3.1. 4.1  Image  Proce.ssor  -  HMD  Display  Control  Module  Interface^^^^^^ 


The  image  processor  -  HMD  display  control  module  interface  shall^^sist  ola‘«,  foot  long 
coaxial  cable  that  carries  a  composite  analog  RS-I70A  video  signal  iffi^rframes/sip.  A  second 


X 


leader,  mu.st  be 


identical  cable  shall  be  provided  if  a  second  viewer; 


accommodated. 

3.3.1.4,2  Image  Proce.ssor  -  TV  Monitor  Interface 


The  image  processor  -  TV  monitor  interface  shall^consisi^f  one"*^*?  foot  long  75  ohm  coaxial 
cable  with  a  that  carries  a  composite  analog  RS-17^^i^eSi^^  at  30  frames/sec. 

3.3. 1.5  Image  Processor  Control  Interfaces 

The  image  processor  shall  accept  control  inpu^ft^tethe  following  sources: 

1 )  head  tracker  ^ 

2)  developer’s  control  panel 

3)  commander’s  control  p^|4 

4)  squad  leader’s  joystick.  X 


3.3.1 .5.1  Head  Tracker  SignaWi®^'$o#L.  Image  Processor  Interface 


The  head  tracker  signal  proc^fsor<^:Jjai^e  processor  interface  shall  consist  of  a  10  foot  long  RS- 
232  cable  that  canies  ang^i^|jTiotion  oata  from  the  head  tracker  signal  processor  to  the  image 
processor. 


3.3.1. 5.1.1  Deyaop£y  Control  Panel  -  Image  Processor  Interface 


‘X'J 


The  developer’s  controhj^iel  -  image  processor  interface  shall  consist  of  a  10  foot  long  RS-232 
cable  that  carries  image  processor  control  commands  from  the  developer’s  control  panel  to  the 
image  processor. 


3.3,1. 5.1. 2  Developer^s  Control  Panel  -  RS-232  Switch  Interface 

The  developer’s  control  pane!  -  RS-232  switch  interface  shall  consist  of  a  10  foot  Jong  RS-232 
cable  that  carries  camera  control  commands  from  the  control  panel  to  the  RS-232. 
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3.3.1.5.1.3  Commander’s  Control  Pane!  -  Developer’s  Control  Panel  Interface 

The  commander’s  control  pane!  -  developer’s  control  panel  interface  shall  consist  of  a  10  foot 
long  RS-232  cable  that  carries  control  signals  from  the  commander’s  control  panel  to  the 
developer’s  control  panel  (PC.  It  is  desired  that  the  ASCII  representations^r  these  control 
signals  be  the  same  as  for  the  developer’s  control  panel  ~  image  processor  int^^e  described  in 
paragraph  3. 3. 1.5. 1.1  above  so  that  the  Commander’s  control  panel  can  rgplac^^e  developer’s 
control  panel  or  PC. 

3.3.1.5.1.4  Developer’s  Control  Panel  -  Squad  Leader’s  Joysticklf^Lrface 


3.3.1. 5.2  Commander’s  Control  Panel  -  Image  Process«fc|en|||^^ 


The  commander’s  control  panel  -  image  processoM|ilcrfacc| 
232  cable  that  carries  control  signals  from  th^c^nw 
processor. 


shalPronsist  of  a  10  foot  long  RS- 
fefe  control  panel  to  the  image 


3.3.1. 5.3  Squad  I.,eader’s  Joystick  -  Image^Sce.si^:'|nterface 


3.3.1 .6  HMD  Display  Control  * 


3.3.1.6.1  HMD  Display  Control  ModiS|i*.He!met  Display  Interface 


The  helmet-Dioonted  display  -  helmet  display  interface  shall  consist  of  a  three 

foot  long  cable  that  carries  i^l^^^^mchronization  .signals  to  the  flat  panel  in  the  helmet 


display  assembly. 


3.3.1.6.2  HM]^Hipl^pl!ontril  Module  -  Image  Processor  Interface 

The  HMD  displaiy^^^l  module  -  image  proces.sor  interface  shall  consist  of  a  15  fool  long 
coaxial  cable  that  carn^^^mposite  analog  RS-170A  video  signal  at  30  frames/sec. 

3.3.1.6.3  HMD  Display  Control  Module  -  FBCB2  Tactical  Data  Interface 

The  HMD  display  control  module  ~  FBCB2  Tactical  Data  Interface  shall  con.sist  of  a  15  foot 
long  cable  with  a  1 5-pin  connector  at  the  FBCB2  terminal  end.  The  FBCB2  interface  shall  be  a 
standard  VGA  interface  as  found  on  standard  persona!  computers 


3.3.2  User  Interfaces 
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3.3.2. 1  Developer’s  Control  Pane!  User  Interface 

The  developer’s  control  panel  user  interface  shall  consist  of  a  standard  laptop  computer  with 
keyboard  and  mouse.  ^ 

3.3.2.2  Commander’s  Control  Panel  User  Interface  ^  , 


The  commander’s  control  panel  user  interface. 

3.3.2.3  Squad  Leader’s  .loystick  User  Interface 


3.3.2.4  HMD  Display  Control  Module  User  Interface^^^^^'j^^ 

The  HMD  display  control  module  interface  shall  c(^si^^^^^;gJowing  controls: 

a)  video  mode  select  switch  -  a  five-position  r^j^wrich  that  selects  either: 

2)  the  RS-1 70  input  from  the  pfd^ssor, 

3)  the  VGA  input  from  the  Fj^l^llEOceskor. 

4)  the  RS-1 70  input  front  ai^ferna^^oiirce  (not  used),  or 

5)  a  TBD  function 

b)  1“  mode  .select  (not  use||  -  I'lfeeg-i^^ition  rotary  switch  that  puts  and  external  I" 
sensor  in  either: 

1)  the  OFF  state, 

2)  the  ON  state  (^^rout'aniliuminator),  or 

3)  the  ON  .state  'wth-4Ti  ifluminator  ON. 

c)  helmet  mounted  cpplS^^nfiroIs  -  three  pushbuttons  that  operate  as  follows: 

1)  the  cen^fi pushbutton  on  successive  depressions  rotates  between  either 
^j^J[T^^S:,or  CONTRAST  adjust, 

2)  ^pe  Lfi.'|rro\vftoShbutton  on  successive  depressions  increases  the  brightness  or 

by  one  unit. 

3)  uk^^^OWN  arrow  pushbutton  on  successive  depressions  decreases  the 
brigiftt^ss  or  contrast  by  one  unit. 

The  HMD  display  control  module  shall  be  mounted  on  the  user  (commander  or  squad  leader) 
using  a  clip  or  velcro,  and  shall  have  quick-disconnect  connectors  for  all  the  cables  to  allow 
unimpeded  egress  from  the  vehicle. 


3.3.2.5  HMD  Display  User  Interface 

The  helmet-mounted  display  shall  having  the  following  user  interface  features: 
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1)  it  shall  mount  on  a  standard  DH-132  CVC  helmet  and  liner  (MIL-H-441 17A),  with  a 
standard  M-138/G  microphone  and  MK-1697/G  headset.  No  new  holes  shall  be 
required  in  the  helmet  to  mount  the  display. 

2)  it  shall  be  easily  removable  from  the  helmet  without  tools,  and  shall  be  stowable  in 

the  vehicle  as  a  vehicle  retained  unit  (VRU),  * 

3)  it  shall  be  physially  and  functionally  compatible  with  a  Land  Waiifec  display  having 

the  following  user  interface  features:  ^ 

a)  monocular,  either  left  eye  or  right  eye, 

b)  direct  view,  allowing  all  of  the  following  mi^^ 

a)  directly  in  front  of  the  eye,  ‘W 

b)  look-over  capability, 

c)  look-under  capability, 

6)  640x480  pixels, 

7)  26°xir  field  of  view, 

8)  monochrome, 

9)  exit  pupil  size:  25  mm, 

10)  eye  relief;  35  mm. 

The  helmet-mounted  display  unit  shall  be  mounta^^ppa^fedard  combat  vehicle  crew  (CVC) 
helmet  without  requiring  any  additional  hole^iK  thl'^toet  and  using  no  special  tools.  The 
display  shall  be  mountable  in  .such  a  manner|^w|j^lo\w  either  left  eye  or  right  eye  operation. 
The  display  shall  have  two  positions  on  the.<Mgiet?li;idperating  position  and  a  stow  position.  In 
the  stow  position  the  di.splay  shall  b^tlime^^^>.  In  the  operating  position  the  display  mount 
shall  permit  both  a  look  over  and^topk^Hlpr  ™jde  of  operation.  The  display  mount  shall  not 
interfere  with  the  use  of:  ^^*^**' 

1 )  personal  eyeglasses, 

2)  sand,  wind  ,  and  dus^^^^es.  the  storage  of  these  goggles  on  the  top  of  the 

3)  NBC  mask, 

4)  head  rests  whilell^g  any  sights  inside  the  vehicle. 


5)  movina 


3.3.2.6  Head 


hatch  in  either  direction. 


lU  User  Interface 


The  head  tracker  inertHB^asurement  unit  shall  mount  on  a  standard  DH-132  CVC  helmet  and 
liner  (MIL-H-44n7A).  wlh  a  standard  M-138/G  microphone  and  MK-1697/G  headset.  No  new? 
holes  shall  be  required  in  the  helmet  to  mount  the  inertial  measurement  unit.  The  inertial 
measurement  unit  shall  be  easily  removable  from  the  helmet  without  tools,  and  shall  be  stowable 
in  the  vehicle  as  a  vehicle  retained  unit  (VRU). 

33.2.7  rBCB2  U.ser  Interface  (Optional) 

The  STTV  system  shall  provide  an  RS-422  control  interface  that  supplies  user  inputs  to  an 
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embedded  tactical  di.splay  or  an  Applique+  di.splay  for  preparing  reports.  The  RS-422  control 
output  shall  enable  the  HMD  to  provide  the  same  capabilities  that  are  provided  by  the  embedded 
tactical  display  or  Applique+  di.splay: 

1 )  di  spl  ay  cu  rsor  control , 

2)  tactical  display  function  buttons  miraic’d  by  on-screen  buttons,  . 

3)  tactical  display  numerical  pad  mimicM  by  on-screen  numerical  padfev  . 

This  interface  shall  not  be  required  in  the  STTV  demonstration  system  usedon  13. 


3.3.3  Vehicle  Interfaces 

3.3.3.1  Mechanical  Interfaces 

3.3.3.1 .1  Sensor  -  Vehicle  Mechanical  Interface 

When  used  on  an  Ml  13  vehicle,  the  sensor  unit  (comb^HTp^^mic  and  gimbaled  sensors) 
shall  be  mounted  in  the  square  hatch  on  lop  of^he  ^g|epger^ompartment  in  back  of  the 


commander's  hatch  using  a  wooden  frame  constract^Jorl|m,;purpose.  The  cables  shall  run 
through  the  frame  into  the  passenger  compartment  training  system  components  are 

stowed. 

When  used  on  an  Ml  A2  Abrams,  the  sensor  ipit'%^1  bclocated  on  a  stationary  mount  on  top  of 

.witf 


the  CITV  sensor  on  the  turret,  but  not Jp  i !W|fe  rotating  tun'Ct. 

3.3.3.1 .2  Image  Processor  -  Vebtcle  I^ep|tanicaf  Interface 


W^hen  used  on  an  Ml  13  vehicle,  the  ima^ei, processor  shall  be  mounted  in  a  19  inch  rack  located 
in  the  passenger  compartment. 

3.3.3.1.3  Power  Supply  -  'p%hIde''M^anical  Interface 

W'hen  used  on  an  M|J3’ vehicle,  the  power  supply  shall  be  mounted  in  a  19  inch  rack  located  in 
the  passenger  comj^aftm^t. 


3.3.3.1 .4  RS-232''S^teh  -  Vehicle  Mechanical  Interface 


When  used  on  an  M  l  13  vehicle. 'the  RS-232  switch  shall  be  mounted  in  a  19  inch  rack  located  in 
the  passenger  compartment. 

3.3.3.1.5  Commander’s  Control  Panel  -  Vehicle  Mechanical  Interface 

The  commander’s  control  pane!  shall  be  mounted  inside  the  commander’s  hatch  in  a  position  that 
allows  the  commancer  to  reach  the  controls  either  while  standing  in  the  hatch  or  while  .sitting  in 
the  closed  vehicle. 
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3.3.3.1.6  Squad  Leader’s  Joystick  -  Vehicle  Mechanical  Interface 


The  squad  leader’s  joystick  shall  be  located  in  the  passenger  compartment  of  either  an  Ml  13  or 
M2/M3  Bradley  in  a  position  where  it  is  accesible  while  using  the  FBCB2  tactical  terminal. 


3.33.2  Electrical  Interfaces 


3.3.3.2.1  Power  Supply  -  Vehicle  Electrical  Interface 


The  STTV  power  supply  shall  operate  from  a  110  VAC  power  in 
28  VDC  vehicle  power  source  per  MIL-STD-1275. 

V 

33.3.2.2  CITY  -  Image  Processor  Interface 


The  STTV  image  processor  shall  have  a  modified  |^-I7w&git  inSlfiice  to  accept  the  data  from 
an  HTl  second  generation  FLIR  used  as  a  CommSd^js  Iro^endent  Thermal  Viewer  (CITY). 
(This  interface  shall  not  be  required  in  the  STTV  demol^^pn'^system  used  on  an  Ml"”' 


3.3.3.2.3  Developer’s  Control  Panel  -  HTI  FJLMR  Cll|teol  Interface 


The  STTV  system  shall  have  an  RS-^2  ccAgl  o^i|f'to  provide  user  control  to  a  HTl  second 
generation  FLIR  sensor.  (This  interf®^shau^^^;|»q  required  in  the  STTV  demonstration  system 
used  on  an  Mil 3). 

3.4  .4cronvms 


AMEL 

CCD 

CITY 

CIV 

cve 

FBCB2 

FLIR 

FOR 

FOV 

HTI 

HMD 

Hz 

ICCD 

IHAS 

IVIS 

NBC 


Act i  ve  M  ^i^|B  ei^olu  m  i  nescen  t 
Charg^i^l^l^vice 
Conjj^&dcr^fTOaependent  Thermal  Viewer 
Eloim^^toN  Independent  View-er 
at^®icle  Crew 

I  Battle  Command,  Brigade  and  Below 


ard  Looking  Infra  Red 
Regard 
of  View' 

Horizontal  Technology  Integration 
Helmet  Mounted  Display 
Hertz 

Intensified  Charge  Coupled  Device 
Integrated  Helmet  Assembly  Subsystem 
Inter  Vehicular  Information  System 
Nuclear  Biological  Chemical 
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NFOV  Narrow  Field  of  View 

SVGA  Super  Video  Graphics  Adapter 

STTV  See-Through  Tank  Visualization 

TBD  To  Be  Determined 

UAV  Unmanned  Aeronautical  Vehicle 

VGA  Video  Graphics  Adapter 

WFOV  Wide  Field  of  View 
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1.  SCOPE 


This  Interface  Control  Document  (ICD)  shall  define  the  interfaces  between  the  Honeywell  See- 
Through  Tank  Visualization  (STTV)  System  modules,  between  the  STTV  system  and  the 
vehicle,  and  between  the  STTV  system  and  the  user. 


2.  REFERENCE  DOCUMENTS 

The  following  documents  form  a  part  of  this  specification  to  the  extent  specified  herein.  In  the 
event  of  a  conflict  between  the  documents  referenced  herein  and  the  contents  of  this 
specification,  the  contents  of  this  specification  shall  be  considered  the  superseding  requirement. 

2.1  Government  Specifications 

System  Requirements  Specification  for  a  See-Through  Tank  Visuali^l^S^pi^,  Honeywell 
Inc,  6  November  1 998 


2.2  Honeywell  Specifications 


m,. 


System  Development  Specification  for  a  See-Through  Tank  wigaljlpion  Sy.stem,  Honeywell 
Inc,  6  November  1998 

Land  Warrior  IHAS  Specification,  Honeywell  Inc|;42  J^l-^y  !§' 


Si" 


3.  SYSTEM  DESCRIPTION 

The  See  Though  Tank  Visualization  Systeni^^^isil^^fthc  following  components  as  showm  in 
Figure  3.1: 

a)  panoramic  sensor  unit 

b)  gimbaled  IR  sensor  unit  V" 

c)  image  processor 

d)  power  supply 

e)  RS-232  switch 

f)  developer’s  controlj^t!bl:| 

g)  helmet  assembly  vf 

h)  hclmet-mountc^ispj^f'''X0^ 

i)  display  contr(#||?du!e"'“'*^ 

j)  head  tr^^e^sinc'M&fpeasurement  unit 

k)  hea0||slfck(^pgnal^ll)cessor 

l)  coi^^l^^f' control  panel 

m)  squadf^^r;’s  joystick  control 
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Figure  3.1  See-Through  Tank  Visualization  Systeny^^^fcpts 


4.  INTERFACE  REQUIREMENTS 

4.1  Internal  System  Interfaces  ^  jM ^  . 

Internal  system  interfaces  are  shown  schematical^^i^^^^fe'jf. 

4.1.1  Sensor  -  Image  Processor  Interfaces 

The  system  shall  have  two  sensor  -  process^iMcrfa^':  1)  a  gimbaled  sensor  video  /  RS-232 


interface,  and  2)  a  panoramic  sensor  video 

4. 1 . 1 . 1  Gimbaled  Sensor  Vide<xanfl.^^^3lf|ilerface 

The  gimbaled  sensor  video  and  Ki|M2  iri®fecc  shall  consist  of  a  10  foot  long  cable  assembly 
as  shown  in  Appendix  1,  cable  TlfiiC^ble  shall  have  a  J9  pin  ITl’  Neptune  connector  with 
three  coaxial  pins  at  the  sensor^^^d’''tl#ee  75  ohm  coaxial  BNC  connectors  at  the  processor 
end  along  with  three  femaieJ>^5,^^!^ctors  and  a  system  ON/OFF  switch. 

The  three  75  ohm  coaxia^^-c'co^^tors  shall  carry  RS-170A  composite  interlaced  video  data 
from  the  microbo|^g^r All  three  connectors  shall  carry  the  same  video  information. 
The  microboloni^lr"sSgor  siSPfiave  320x240  pixels  and  a  field  of  view  of  1 5.5“^  (H)x  1 1 .5°(V). 

One  of  the  three  ft^p|^pB-9  connectors  shall  carry  RS-232  signals  and  the  other  two  .shall  carry 
RS-422  signals.  Pino^^ms  for  these  connectors  arc  shown  in  Appendix  1 ,  cable  P.  The  RS- 
232  encoded  signals  shall  carry  azimuth  and  elevation  slewing  signals  to  the  gimbal  from  the 
processor  and  azimuth  and  elevation  gimbal  position  signals  from  the  gimbal  to  the  processor. 
The  ASCII  codes  representing  these  gimbal  commands  and  gimbal  positions  are  listed  in 
Appendix  2.  RS-422  signals  on  the  remaining  two  female  DB-9  connectors  are  not  defined  at 
this  time. 
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The  system  ON/OFF  control  shall  consist  of  a  single  wire  in  the  cable  that  is  connected  to  an 
SPOT  switch  at  the  processor  end.  The  other  side  of  the  SPDT  switch  is  connected  to  the  ground 
side  of  the  +28  VDC  supply  that  powers  the  gimbal.  When  the  switch  is  closed,  (i.e.,  the  control 
wire  grounded)  the  gimbal  slewing  motors  and  microbolometer  sensor  are  all  turned  ON. 
Immediately  after  tum-on,  the  gimbal  and  sensor  go  into  a  self-calibration  mode  during  which 
the  gimbal  slews  to  zero  degrees  and  points  down  at  a  reference  target.  After  calibration  is 
complete,  the  gimbal  slews  up  in  elevation  to  a  standard  position.  The  gimbal  is  then  ready  to 
accept  slewing  commands  from  the  processor. 


4.1.1.2  Panoramic  Sensor  Video  Interface 


The  panoramic  sensor  video  interface  shall  consist  of  a  10  foot  long  cable  asembly  as  shown  in 
Appendix  1,  cable  H.  The  cable  shall  have  a  38999  connector  with  eigl®|paxial  pins  at  the 
sensor  end  and  eight  75  ohm  coaxial  BNC  connectors  at  the  processor^dj^foe  eight  coaxial 
connectors  shall  carry  the  RS-170A  interlaced  composite  video  dataj^M^^^^t  visible  TV 

lera  shaOl 


cameras  in  the  panoramic  .sensor  assembly  to  the  processor.  Each j^tera  shalf^ve  a  field  of 
view  of  45°(H)x42°(V)  with  approximately  512  pixels  in  the  horiz^^i^irectioiiliy  494  pixels 
in  the  vertical  direction.  (The  camera  actually  has  659x494  pixa^^rml^i  over  a  lens  FOV  of 
58°(H)x42°(V).  but  only  the  middle  45'^  in  the  horizontal  di®4i^Rfe|ft*sed).  All  the  pixels  in 
both  the  odd  and  even  RS-170A  fields  are  illuminated  simulraii^u.sft." 


Scan  converters  in  the 

sensor  assembly  re-format  the  field-parallel  outputs  of  ea^^Hjerai^tb  standard  field-sequential 
RS-170A  signals  to  the  processor.  All  cameras  are  s|^hr(^^p  by  the  same  horizontal  and 
vertical  TTL  sync  signals,  producing  pixe!-^^pchrS|p||.^yideB  output.  The  processor  is 
synchronized  using  the  composite  sync  included  ih  ^iRS^f^llA  interlaced  outputs. 

•^y||F 


4.1.2  Sensor  -  Power  Supply  Interface 

The  sensor  -  power  supply  interface  shall  ofWo  1 0  foot  long  cable  assemblies,  cable 

WIK  (three  diagrams  in  one  cable)  and  Sj4,sep^^tb, cable),  as  shown  in  Appendix  I  cables  W^ 
K,andS. 


Cable  WIK  shall  have  a  5 1  -pin  3i^^.cdfi^C|or  at  one  end  and  multiple  U-.shaped  terminals  at 
the  other  end.  Sub-cable  W  of  calSil^pKHall  carry  +5  VDC  power  to  the  panoramic  sensor 
unit.  It  shall  have  eight  +5  VDg^^|;r  li^inals  and  eight  +5  VDC  return  (ground)  terminals  at 
the  power  supply  end.  Sub-c^fe  ^^able  WIK  shall  carry  +12  VDC  power  to  the  panoramic 
sensor  unit.  It  shall  have  power  terminals  and  eight  +12  VDC  return  (ground) 

terminals  at  the  power  suM^ 


Cable  S  shall 


Neptune  connector  at  the  sensor  end  and  multiple  U-shaped 
terminals  at  th^^^wq^slipply  end.  It  shall  carry  +24  VDC  power  to  the  gimbaled  sensor  unit. 
Cable  S  shall  h£rf|||^^*  +24  VDC  power  terminals  and  nine  +24  VDC  return  (ground)  terminals 
at  the  power ; 
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4,1.3  Sensor  -  RS-232  Switch  Interface 

The  sensor  -  RS-232  switch  interface  shall  consist  of  one  10  foot  long  cable  assembly,  subcable 
I  of  cable  WIK,  as  shown  in  Appendix  1,  cable  I.  The  cable  shall  have  a  51 -pin  38999 
connnector  at  one  end  and  eight  DB-25  male  connectors  at  the  other  end.  Pin  diagrams  for  the 
DB-25  connectors  are  shown  in  Appendix  1,  cable  1.  The  cable  shall  carry  RS-232  control 
signals  from  the  developer’s  control  panel  to  the  eight  cameras  in  the  panoramic  sensor  unit.  The 
RS-232  encoded  signals  shall  permit  changing  the  camera  integration  time,  gain,  and  output 
modes.  The  ASCII  codes  representing  these  camera  modes  are  listed  in  Appendix  3. 


4. 1 .4  Image  Processor  -  Display  Interfaces 

The  image  processor  shall  provide  video  outputs  to  the  Honeywell 
mounted  display  and  to  a  standard  TV  monitor.  4 


Sj  Warrior  helmet 


4.1.4.1  Image  Processor  -  HMD  Display  Control  Module  Intei^ 

The  image  processor  -  HMD  display  control  module  interface  sh^ 
ohm  coaxial  cable  with  a  75  ohm  BNC  connector  at  the  ima^^^g 
Lemo  connector  at  HMD  display  control  module  end.  A^a® 


^fe,,of  a  TS  foot  long  75 


Appendix  4.  The  cable  shall  carry  a  composite  analog  R^gOAl 
If  the  system  must  accommodate  a  second  viewer, 
commander,  then  a  .second  identical  cable  shall  bemro>^&. 


and  a  male  8  pin 
diagram  is  shown  in 
signal  at  30  frames/xec. 
mad  leader  in  addition  to  a 


4.1. 4.2  Image  Processor  -  TV  Monitor  Interfac^J 

The  image  processor  ~  TV  monitor  interface 

cable  with  a  75  ohm  BNC  connector  at  each^fi.  TMp 

1 70A  video  signal  at  30  frames/xec. 


sWbf  one  15  foot  long  75  ohm  coaxial 
^ble  shall  carry  a  composite  analog  RS- 


rom  the  following  sources; 


4.1.5  Image  Processor  Control  IfffirJiiCira 

-  ,  .. 

The  image  processor  shall  accepts^^'o!  itip 

1 )  Intersense  head  tracker 

2)  developer’s  control 

3)  commander’s  conti^^*^®)^ 

4)  squad  leader’s 


4.1.6  Head  Track|^^^^^^^essor  -  Image  Processor  Interface 

The  head  tracke^^n^^oce^^"-  image  processor  interface  shall  consist  of  a  10  foot  long  RS- 
232  cable  connector  at  the  tracker  signal  processor  end  and  either  a  DB-25 

connector  at  the  m^^^rocessor.  The  cable  shall  be  configured  as  a  null  modem  cable  as  shown 
in  Table  1;  i.e..  with  at  each  end  connected  to  the  RX  at  the  other  end,  and  the  grounds  at 

each  end  connected  togSher.  The  cable  shall  carry  angular  motion  data  from  the  head  tracker 
signal  processor  to  the  image  processor  at  a  selectable  baud  rate  of  9,600  to  1 15.200  bps.  The 
PC  commands  used  to  operate  the  tracker  and  are  listed  in  Appendix  5. 
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Table  I .  Head  tracker  cable  wiring  diagram 


Intersen.se  Port 

Processor  Port 

Processor  Port 

DB-9 

DB-9 

DB-25 

Pin  /  Signal 

Pin  /  Signal 

Pin  /  Signal 

1  (DCD) 

2(RX) 

3(TX) 

3(TX) 

3  (TX) 

2  (RX) 

2  (RX) 

4  (DT  R) 

5  (GND) 

5  (GND) 

7  (GND) 

6  (DSR) 

7  (RTS) 

8  (CTS) 

9  (RI) 

: . . . .  ^ 

4.L6.1  Developer’s  Control  Panel  -  Image  Processor  Interface 

The  developer’s  control  panel  -  image  processor  interface  shalMiS 


The  developer’s  control  panel  -  image  processor  interface  shal|^wfi|koPtTO  foot  long  RS-232 
cable  with  a  female  DB-9  connector  at  the  control  panel  (PC)  i#3^^^ale  DB-25  connector  at 
the  image  processor  end.  The  cable  shall  be  configured  as^§,.null  cable  as  shown  in  Table 

1;  i.e.,  with  the  TX  at  each  end  connected  to  the  RX  at  th^il^ggll^and  the  grounds  at  each  end 
connected  together.  The  cable  shall  carry  irpage  ^g^ei^^p-ontrol  commands  from  the 
developer’s  control  panel  to  the  image  processe^^^  baud  rate  of  9,600  to  1 15,200 

bps.  ITie  PC  commands  used  to  control  the  image  listed  in  Appendix  6. 


4.1.6.1.1  Developer’s  Control  Panel  -  RS-2^'l^^tch  fliterface 

The  developer’s  control  panel  -  RS-232  swlilttlfeterfa&  shall  consist  of  a  10  foot  Ions:  RS-232 
cable  with  a  female  DB-9  connector  ,|t  thop^troTT^el  (PC)  end  and  a  male  DB-25  connector  at 
the  RS-232  switch  end.  The  cable  Hflibc^^ftiilgured  as  a  null  modem  cable  as  shown  in  Table 
1 ;  i.e..  with  the  TX  at  each  end  c|^necfii(^dhS^X  at  the  other  end,  and  the  grounds  at  each  end 
connected  together  —  ask  Sarndli|i|.thiii|^orrect).  ITie  cable  shall  carry  camera  control 
commands  from  the  control  panel jo  l^|^-232  switch  at  a  selectable  baud  rate  of  75  to  19,200 
bps.  The  ASCII  commands  used  to:;|fetrSfee  RS-232  switch  are  listed  in  Appendix  7. 


4.1.6.1.2  Commander’s  ppritrpl  Piicl  -  Developer’s  Control  Panel  Interface 

The  commander’s  £Qntr(i|||^ie!  -  developer’s  control  panel  interface  shall  consist  of  a  10  foot 
long  RS-232  cabl|§p^||a  fd^pp  DB-9  connector  at  the  commander’s  control  panel  end  and  a 
female  DB-9  cj^ect(0il  the  developer’s  control  panel  (PC)  end.  The  cable  shall  be  configured 
as  a  null  modeihi^M^tjfe  shown  in  Table  1;  i.e.,  with  the  TX  signal  at  each  end  connected  to  the 
RX  signal  at  the  S®^^nd,  and  the  grounds  at  each  end  connected  together.  The  cable  shall 


carry  control  signals  ffSW'the  commander’s  control  panel  to  the  developer’s  control  panel  (PC) 
at  a  selectable  baud  rate  of  9,600  to  115,200  bps.  The  control  signals  and  their  ASCII 
representations  are  listed  in  Appendix  9.  It  is  desired  that  the  ASCII  representations  for  these 
control  signals  be  the  same  as  for  the  developer’s  control  panel  -  image  processor  interface 
de.scribed  in  paragraph  4. 1.6.1  above  so  that  the  Commander’s  control  panel  can  replace  the 
developer’s  control  panel  or  PC.  NOTE;  When  this  replacement  is  done,  tlie  interface  is 
described  in  paragraph  4.1 .6.1 .3  below. 
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4.1.6.1.3  Developer’s  Control  Panel  -  Squad  Leader’s  Joystick  Interface 
TBD 


4. 1.6.2  Commander’s  Control  Panel  -  Image  Processor  Interface 

The  commander’s  control  pane!  -  image  processor  interface  shall  consist  of  a  10  foot  long  RS- 
232  cable  with  a  female  DB-9  connector  at  the  commander’s  control  panel  end  and  a  female  DB- 
25  connector  at  the  image  processor  end.  The  cable  shall  be  configured  as  a  null  modem  cable  as 
shown  in  Table  1;  i.e.,  with  the  TX  signal  at  each  end  connected  to  the  RX  signal  at  the  other 
end,  and  the  grounds  at  each  end  connected  together.  The  cable  shall  carry  control  signals  from 
the  commander’s  control  panel  to  the  image  processor  at  a  selectable  b^  rate  of  9,600  to 
1 15,200  bps.  The  control  signals  and  their  ASCII  representations  are  listed  ^wppendix  9. 

4.1.6.3  Squad  Leader’s  Joystick  -  Image  Processor  Interface 
TBD 

4.1.7  HMD  Display  Control  Module  Interfaces 


must  accommodate  a  second 
second  identical  cable  shall  be 


4.1.73  HMD  Display  C 


4.1.7.1  HMD  Display  Control  Module  -  Helmet  Disp| 

The  helmet-mounted  display  control  module  -  helme^l 
foot  Ions  cable  with  a  male  30  pin  Lemo  connec^at  ^ 
30  pin  Omnetics  connector  at  the  helmet  display  eiwi^, 

6.1,  cable  X.  ^ 


4. 1.7.2  HMD  Display  Control  Module  • 

The  HMD  display  control  module 
ohm  coaxial  cable  with  a  75  ohm 
Lemo  connector  at  HMD  display^^ntf 
The  cable  shall  carry  a  composit 


rface  shall  consist  of  a  three 
Ijplay  control  module  end  and  a  male 
e  diagram  is  shown  in  Appendix 


Pr 


ssor  Interface 

'OcS^^f interface  shall  consist  of  a  15  foot  long  75 
r  at  the  image  processor  end  and  a  male  8  pin 
^nd.  A  cable  diagram  is  shown  in  Appendix  4. 
^ft70A  video  signal  at  30  frames/xec.  If  the  system 
a'^squad  leader  in  addition  to  a  commander,  then  a 


FBCB2  Tactical  Data  Interface 

FBCB2  Tactical  Data  Interface  shall  consist  of  a  15  foot 


The  HMD  display  contn 
long  cable  with  l^^^xmo  connector  at  the  HMD  display  control  module  end  and  a 

female  15-pin  l^gonnC'^OT  at  the  FBCB2  terminal  end.  The  FBCB2  interface  shall  be  a 
standard  VG.A^ferf^p' as  found  on  standard  personal  computers,  and  shall  have  the  pinout  as 
shown  in  Table  with  the  15  pin  connector  shall  have  an  additional  stub  10  feet  long 

that  contains  four  ad^^hal  wires,  including  a  -t24  'VDC  power  and  ground  for  supplying  the 
DCM  with  power. 
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Table  2.  Contact  diagram  for  VGA  interface  (female  DB-9  connector) 


Socket 

Number 

Signal 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

. ^ 

12  ^ 

13 

14 

II" 

15 

— >  ■■  iMSAvi*,. - iiiii 

hi: 


4.2  User  Interfaces 

4.2.1  Developer’s  Control  Panel  User  Interface 

The  developer’s  control  panel  user  interface^®]  ct 
equivalent)  with  keyboard  and  mouse  (or  eq^Sililt 


of  a  standard  Dell  laptop  computer  (or 


4.2.2  Commander’s  Control  Paifi>^sOTp|||face 


The  commander’s  control  panekj^gr  i^g|pe  fs  shown  in  Appendix  9,  Figure  1.  The  STTV 
system  modes  of  operation  contrOT^Igi^"^^  interface  shall  be  as  described  in  Appendix  10, 


Table  1. 

4.2.3  Squad  Leader’s  Jo^s 

,, 


4.2.4  HMD 


=l^€!§3nterface 


lodule  User  Interface 


The  HMD  dis^Vcon®  module  interface  shall  consist  of  the  following  controls: 

1)  vide(^^^select  switch  -  a  five-position  rotary  switch  that  selects  either; 

b)  the  ife-170  input  from  the  image  processor, 

c)  the  VGA  input  from  the  FBCB2  processor, 

d)  the  RS-1 70  input  from  an  alternate  source  (not  used),  or 

e)  a  TBD  function  (not  used). 
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2)  f  mode  select  (not  used)  -  a  three-position  rotary'  switch  that  puts  an  external  1“ 
sensor  in  either: 

a)  the  OFF  state, 

b)  the  ON  state  (without  an  illuminator),  or 

c)  the  ON  state  with  an  illuminator  ON. 

3)  helmet  mounted  display  controls  -  three  pushbuttons  that  operate  as  follows: 

a)  the  center  pushbutton  on  successive  depressions  rotates  between  either 
BRIGHTNESS  or  CONTRAST  adjust, 

b)  the  UP  arrow  pushbutton  on  successive  depressions  increases  the  brightness 
or  contrast  by  one  unit, 

c)  the  DOWN  arrow  pushbutton  on  successive  depressions  decreases  the 
brightness  or  contrast  by  one  unit. 


The  HMD  display  control  module  shall  be  mounted  on  the  user  (commano^^r  squad  leader) 
using  a  clip  or  velcro,  and  shall  have  quick-disconnect  connectors  fo^fc^^^^bles  to  allow 
unimpeded  egress  from  the  vehicle. 


4.2.5  HMD  Display  User  Interface 

The  helmet-mounted  display  shall  having  the  following  user  ir 

a)  it  shall  mount  on  a  standard  DH-1 32  CVC  helmet 
standard  M-138/G  microphone  and  MK-16^^^ 
required  in  the  helmet  to  mount  the  display 

b)  it  shall  be  easily  removable  from  the^ln^^^^ 
the  vehicle  as  a  vehicle  retained  unit  tvJtel 

c)  it  shall  be  physically  and  f unctionally'  ^fca.ti 
having  the  following  user  interface 


let  »ic|||n#TMlL-H-441 17A),  with  a 
No  new  holes  shall  be 

^■^mlools,  and  shall  be  stowable  in 

|ti6le  with  a  Ltind  Warrior  display 


d)  monocular,  either  left  eye  or  righfa^. 

e)  direct  view,  allowing  all  of  the  iplf^te 


f)  directly  in  front  of  the  ejii^  ^ 

g)  look-over  capability, 

h)  look-under  capabilit^A:!,x,  x 

i)  640x480  pixels. 

j)  26°x  1 9®  field  of  viewfe^"^^ 


k)  monochrome, 

l)  exit  pupil  size: 

m)  eye  relief:  35  r®. 

mm 


The  helmet-mou^pii^)la;^M?  shall  be  mountable  on  a  standard  combat  vehicle  crew  (CVC) 
helmet  without^feuiry  any  Mditional  holes  in  the  helmet  and  using  no  special  tools.  The 
display  shall  b^^^^pble  in  such  a  manner  as  to  allow  either  left  eye  or  right  eye  operation. 
The  display  shall  n^miafo  positions  on  the  helmet:  an  operating  position  and  a  stow  po.sition.  In 
the  stow  position  the^^lay  shall  be  turned  off.  In  the  operating  position  the  display  mount 
shall  permit  both  a  look  over  and  a  look  under  mode  of  operation.  The  display  mount  shall  not 
interfere  with  the  use  of: 

a)  personal  eyeglasses, 

b)  .sand,  wind  ,  and  dust  goggles,  and  the  storage  of  these  goggles  on  the  top  of  the 
helmet. 
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c)  NBC  mask, 

d)  head  rests  while  using  any  sights  inside  the  vehicle, 

e)  moving  through  the  open  hatch  in  either  direction. 

4.2.6  Head  Tracker  IMU  User  Interface 

The  head  tracker  inertia!  measurement  unit  shall  mount  on  a  standard  DH-132  CVC  helmet  and 
liner  (MIL-H-441 17A),  with  a  standard  M-138/G  microphone  and  MK-I697/G  headset.  No  new 
holes  shall  be  required  in  the  helmet  to  mount  the  inertial  measurement  unit.  The  inertial 
measurement  unit  shall  be  easily  removable  from  the  helmet  without  tools,  and  shall  be  stowable 
in  the  vehicle  as  a  vehicle  retained  unit  (VRU). 


4.2.7  FBCB2  User  Interface  (Optional)  ^ 

The  STTV  system  shall  provide  an  RS-422  control  interface  to  provi<^^ser  inputs  to  an 
embedded  tactical  display  or  an  Appliquc+  display  for  preparing  report^A^^^dype  connector 
shall  be  employed.  The  RS-422  control  output  shall  provide  the  fc^wi^^i^teilities  to  the 
HMD  that  are  provided  by  the  embedded  tactical  display  or  Appliqiij^^splay.: 

1)  display  cursor  control, 


2)  tactical  display  function  buttons  mimic ’d  by^i^^^n  Wttons, 

3)  tactical  display  numerical  pad  mimic’d  by  cmfeySilpimerical  pad. 
This  interface  shall  not  be  required  in  the  STTV  demonstrmipn^sy^^Psed  on  an  MU 3. 


4.3  Vehicle  Interfaces 


4.3.1  Mechanical  Interfaces 


4.3.1. 1  Sensor  -  Vehicle  Mechanical  Interfae^"' 

When  used  on  an  M 1 1 3  vehicle,  the  sens<^'^%!(ppm1?ined  panoramic  and  gimbaled  sensors) 


shall  be  mounted  in  the  square  hs^h  c%iip^  orliKe  passenger  compartment  in  back  of  the 
commander’s  hatch  using  a  woode#|i||pe^'^mj|j|pcted  for  this  purpose.  The  cables  shall  run 
through  the  frame  into  the  passe^|j  where  the  remaining  system  components  are 


stowed. 


When  used  on  an  M  l  A2  Abrarflff^%nsdf  unit  shall  be  located  on  a  stationary  mount  on  top  of 
the  CITV  sensor  on  the  tung,  contact  with  the  rotating  turret. 

4.3.1.2  Image  Process(rf)~  Vehicle  Mechanical  Interface 


When  used  on  an^fti^A'chic^hhc  image  processor  shall  be  mounted  in  a  1 9  inch  rack  located 
in  the  passensei^comp^lnent. 


4.3.1. 3  Power  1 


Vehicle  Mechanical  Interface 


W’hen  used  on  an  Ml  13  vehicle,  the  pow'cr  supply  shall  be  mounted  in  a  19  inch  rack  located  in 
the  passenger  compartment. 


4.3.1.4  RS-232  Switch  -  Vehicle  Mechanical  Interface 

When  used  on  an  Ml  13  vehicle,  the  RS-232  switch  shall  be  mounted  in  a  19  inch  rack  located  in 
the  passenger  compartment. 


4.3. 1.5  Commander’s  Control  Panel  -  Vehicle  Mechanical  Interface 

The  commander’s  control  pane!  shall  be  mounted  inside  the  commander’s  hatch  in  a  position  that 
allows  the  commander  to  reach  the  controls  either  while  standing  in  the  hatch  or  while  sitting  in 
the  closed  vehicle. 


4.3. 1 .6  Squad  Leader’s  Joystick  -  Vehicle  Mechanical  Interface 

The  squad  leader's  joystick  shall  be  located  in  the  passenger  compartment  of  either  an  Ml  13  or 
.V[2  M3  Bradley  in  a  position  where  it  is  accessible  while  using  the  FBCB2  tactical  terminal. 

4.3.2  Electrical  Interfaces 


4J.2.1 


Vehicle  Electrical  Interface 


Power  Supply 

Tiic  STTV  power  supply  shall  operate  from  a  110  VAC  power  inv^J|^that  is 
2S  \'DC  \'ehiclc  power  source  per  MlL-STD-1275.  (Note:  This  reqi^w&e  1 10 
operate  o\  cr  the  input  range  of  16VDC  to  30  VDC). 


5.  ACRONYMS 


red  from  the 
inverter  to 


Active  Matrix  Electrolumine: 
Charge  Coupled 
Commander’s  Indepetf|||,' 
Commander’s  IndependS 
Combat  Vehicle  - 
FXXI  Battle  Cor 
Forward 
Field  of  gega 
Field  of 


p»ge  Coupled  Device 
'd^elmet  Assembly  Subsystem 
ar  Information  System 
ilguclearBiological  Chemical 
‘^fegw  Field  of  View 
Su|l^  Video  Graphics  Adapter 
See-Through  Tank  Visualization 
To  Be  Determined 
Unmanned  Aeronautical  Vehicle 
Video  Graphics  Adapter 
Wide  Field  of  View 
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ABSTRACT 

A  combat  vehicle  visualization  system  is  described  that  enhances  the  situation  awareness  of  the  vehicle  commander.  The  system 
consists  of  a  360"  panoramic  sensor,  a  gimhalcd  8-12  pm  infrared  .sensor,  and  a  helmet-mounlcd  display  with  head  tracker.  The 
helmet-mounted  display  can  display  the  fused  sensor  data  to  aid  the  commander  in  vehicle  maneuvering  and  threat  acquisition 
while  buttoned  up.  It  can  also  display  situation  awareness  information  down-loaded  from  the  tactical  internet  while  standing  in 
the  hatch.  Construction  and  operation  features  will  be  described. 

Keywords:  Helmet  mounted  display,  HMD,  situation  awareness,  visualization,  panoramic  camera,  image  processing,  M I A2 


L  INTRODUCTION 


As  a  result  of  lessons  learned  in  Operation  Desert  Storm,  the  U.S,  Army  is  adding  to  its  armored  vehicles  a  selection  of 
electronic  systems  to  enhance  their  lethality  and  survivability  (l^ible  1).  These  systems  give  drivers  and  gunners  improved  tools 
for  peribrming  existing  tasks,  while  they  give  commanders  exciting  new  capabilities  as  well  as  new  demands  on  their  heavy 
workload.  The  commander's  independent  thermal  viewer  on  the  MIA2  Abrams,  for  example,  allows  the  commander  to  hunt 
for  new  targets  while  the  gunner  is  dispatching  an  existing  target,  a  capability  that  was  not  present  on  the  MIAI.  While  this 
provides  up  to  a  60%  improvement  in  the  effective  rate  of  fire ^  the  commander's  attention  may  be  diverted  from  other  essential 
tasks  such  as  vehicle  navigation  and  vehicle  communication. 


Table  1 .  New  and  improved  electronics  for  Army  vehicles 


Electronic  System 

De,scnption 

Use 

GP.S  Navigation  SystenF 

Driver's  Vision  Enhancer  '*'^ 

Gunner's  Primary  Sight 

Battlefield  Combat  ID  System'’’ 

Commander's  independent  Viewer” 
FBCB2  Tactical  Terminal'’' 

Precision  lightweight  GPvS  receiver  (FLGR) 
8-12  micron  uncooled  infrared  sensor 

8-12  micron  2*^'^  generation  FUR  sensor 
Ka-band  narrow  beam  interrogator  plus  omni¬ 
directional  receiver/  transponder 

8-12  micron  2”'^  generation  FLIR  sensor 
Networked  Applique  or  embedded  computer 

Cmdr  driver  navigation 
Driver  terrain  viewing 
Gunner  target  sighting 
Gunner  friend/foe 
identification 
;  Cmdr  target  hunting 

Cmdr  situation  awareness 

The  most  demanding  new  system  for  vehicle  commanders  is  the  FXXI  Battle  Command  Brigade  and  Below  (FBCB2)  tactical 
terminal.  This  networked  computer  system  provides  increased  situation  awareness  in  the  form  of  rapid  accc.ssibi]ity  to  enemy 
and  friendly  positions,  topographical  maps,  commander's  orders,  situation  reporting,  and  vehicle  nceds/statiis  reporting.  The 
situation  awareness  data  allows  the  commander  to  make  more  informed  and  rapid  decisions  locally  prior  to  and  during  an 
enemy  encounter.  But  interaction  with  the  digital  terminal  adds  lo  the  commander's  workload. 

The  commander's  workload  is  stressed  the  most  in  the  case  of  turrcied  armored  vehicles  such  as  the  Abrams  and  the  Bradley. 
When  not  engaging  the  enemy,  the  vehicle  commander  is  trained  to  stand  in  the  hatch  while  the  vehicle  is  moving  and  to  search 
continuously  for  road  hazards,  ground-based  threats,  friendly  forces,  and  other  objects  or  situations  that  might  affect  his  vehicle. 
He  is  constantly  giving  verbal  commands  over  the  vehicle's  intercom  system  to  tell  the  driver  to  torn  right  or  left  or  the  gunner 
to  slew  the  turret  right  or  left.  While  standing  in  the  hatch  he  is  unable  to  use  the  commander's  independent  thermal  viewer 
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(CITV)  or  the  FBCB2  tactical  lermina!  because  their  displays  arc  viewable  only  while  inside  the  turret.  This  makes  it  difficult  to 
prepare  situation  reports  while  maintaining  outside  awareness.  It  may  even  cause  him  to  miss  a  critical  communication  from  his 
commander. 


When  engaging  the  enemy  and  the  vehicle  is  buttoned  up,  the  situation  is  reversed.  In  this  case,  the  CIT\^  display  and  the 
FBCB2  tactical  terminal  are  directly  viewable,  but  the  commander  has  no  awareness  of  the  vehicle's  immediate  surroundings  or 
its  turret-hull  orientation.  The  commander's  independent  thermal  viewer  is  excellent  for  acquiring  targets  at  longer  ranges,  but 
its  narrow  field  of  view  (13,3'^x7.5^  maximum)  and  limited  slew  mte  (60"Vsec)  are  not  well  matched  to  seeing  threats  at  nearby 
ranges  (<  4(K)  meters).  The  commander's  viewing  ports  are  intended  to  provide  such  a  capability,  but  they  are  limited  to  visible 
light  only  and  arc  frequently  taped  over  to  preclude  the  enemy  from  spoiling  the  vehicle  due  to  light  emanating  through  the 
ports. 

With  these  needs  in  mind.  Honeywell  and  the  Sarnoff  Corporation  have  contracted  with  DARFA  to  develop  the  See-Through 
Turret  Visualization  (STIW)  system  (Figure  I  ),  The  STTV  sysietn  provides  the  vehicle  commander  a  36(f'  field  of  view' 
panoramic  image  sensor  along  with  a  ht^lmet  mounted  display  and  head  tracker.  When  not  engaging  the  enemy,  the  helmet- 
mounted  display  allows  the  commander  to  view  the  FBCB2  terminal  data  while  standing  in  the  hatch.  When  engaging  the 
enemy,  the  panoramic  sensor  allows  the  commander  effectively  to  see  through  the  vehicle-s  armor  and  to  view  the  surrounding 
terrain  on  his  helmet -mounted  display.  Panning  around  the  vehicle  is  achieved  naturally  via  the  hcad-iracked  sensor,  leaving 
hands  tree  for  other  duties.  On  a  troop-carrying  armored  vehicle,  such  as  a  Bradley,  the  panoramic  sensor  enables  an  additional 
optional  mode  whereby  the  squad  leader  can  survey  the  surrounding  terrain  before  disembarking  on  a  mission.  In  this  mode  the 
squad  leader  can  pan  the  panoramic  sensor  independently  of  the  vehicle  commander,  allowing  the  commander  and  squad  leader 
to  look  simultaneously  in  different  directions. 


Commander  can  view 
the  surrounding  terrain 
in  any  direction  from 
inside  the  vehicle  using 
the  helmet-mounted 
display 


Commander  can  see 
FBC82  data  and 
CITV  imagery  while 
standing  In  the 
hatch. 


360®  panoramic  image  sensor  with 
helmet-mounted  display  and  head  tracker 


Helmet-mounted  display 
can  be  used: 

*  in  open  hatch 
when  buttoned  up 
while  off  the  vehicle 
(via  personal  radio 
frequency  link)  to 
view: 

-  FSC82  data 

-  CITV  imagery 

-  maintenance  and 
repair  data 


Figure  I .  See-Through  Turret  Visualization  system 


2.  STTV  SYSTEM  DESCRIPTION 


The  foihnving  sections  describe  a  prototype  See-Through  Turret  Visualization  (STTV)  system  developed  using  existing 
components  to  demonstrate  essential  system  features  in  a  cost-effective  manner.  Improvements  envisioned  for  a  deployable 
production  system  arc  addressed  in  Section  3. 

2-1.  360“  Panoramic  Sensor 


The  36C)'  panoramic  sensor  (Figure  2)  consists  of  eight  659x494  pixel  visible  charge-coupled  device  (CCD)  cameras  with  each 
camera  having  a  6  mm  auto  iris  lens  with  a  field  c>j‘  view  of  5(V"XH)x42 'XV).  .4  mirror  arrangement  allows  the  camcra-io-mirror 
distance  to  be  adjusted  so  that  the  cameras  can  he  brought  to  a  common  vinual  focal  point,  eliminating  any  parallax  betw'cen  the 
cameras.  This  assures  tiiat  any  objecls  in  between  two  cameras  are  not  doubly  imaged  or  omitted,  which  can  occur  if  camera 
vergcnce  is  not  changed  with  distance  as  it  is  with  human  eyes.  Actually,  the  camera-to-mirror  distance  is  adjusted  so  that 
adjacent  cameras  have  slightly  overlapping  horizontal  fields  of  view  to  simplify  the  blending  at  image  borders.  This  leaves  a 
residual  parallax  due  to  a  virtual  camera  separation  of  about  Va  to  Vt  inch,  which  is  imperceptible  at  ranges  beyond  about  15  feet. 
A  processor  is  then  used  to  blend  adjacent  images  into  a  combined  intermediate  camera  view,  enabling  continuous  panning 
through  360”  as  though  one  is  looking  at  a  single  360*'  panoramic  image. 
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Another  important  senior  feature  h  that  motion  blur  caused  by  image  offset  between  two  fields  of  the  same  frame  is  completely 
eliminated^  The  cameras  also  have  an  RS-232  interface  that  allows  the  processor  to  change  the  camera  integration  time  and 
gain  settings  in  real  time. 


The  complete  panoramic  sensor  is  14  inches  in  diameter  by  23  inches  high,  W'hich  allows  ii  to  be  placed  on  top  of  an  armored 
vehicle  and  still  see  the  ground  15  feet  aw^ay.  Alternatively,  only  the  13  inch  high  camera  portion  can  be  located  outside  the 
vehicle  with  the  10  inch  high  electronics  portion  placed  inside.  The  sensor  has  a  transparent  acrylic  window  to  keep  out  dust 
and  moisture. 


2.2.  Gimhaled  Infrared  Sensor 

The  gimbalcd  infrared  (!R)  sensor  (Figure  3)  is  a  commercially  available  unit  developed  by  Nytech  Inc.  for  the  United  States 
Army*  \  The  sensor  has  an  RS-I7()  video  output  and  an  NETD  of  less  than  O.IOOK,  U  is  gimbal-mounted  so  that  can  be  slewed 
in  both  the  a/Jmuth  and  elevation  directions.  The  a/jmiith  ginibal  is  capable  of  continuous  rotation.  Its  absolute  pointing 
accuracy  is  one  part  in  4096,  or  5  minutes  of  accuracy.  The  unit  accepts  position  and  velocity  commands  via  an  RS~232 
interface  and  provides  feedback  of  its  intermediate  gimbal  positions  while  slewing.  The  complete  unit  is  14  inches  high  and  10 
inches  in  diameter.  It  dissipates  20  watts  at  idle  and  up  to  200  watts  at  maximum  acceleration.  In  the  STI'V  system  this  sensor 
is  used  to  simulate  the  commander's  forward-looking  infrared  (FLIR)  .sensor  found  on  many  armored  vehicles,  such  as  the 
CITY  on  the  Ml  A2  Abrams  or  the  Commander's  independent  Viewx'r  (CIV)  on  the  M2A3  Bradley,  If  the  vehicle  already  has  a 
commander's  FLIR  onboard,  this  sensor  can  he  omitted.  Otherwise,  it  provides  a  low  cost  alternative  to  a  high  performance 
FLIR  .sensor. 

The  gimbalcd  infrared  .sensor  can  be  mounted  atop  the  36(f'  panoramic  sensor  to  provide  a  merged  sensor  (Figure  4).  The 
sensors  can  be  used  either  singly  or  together  in  a  fused  mode  as  shown  in  Figure  5.  When  viewc'd  on  a  helmct-niounted  display, 
only  a  portion  of  the  360"'  field  of  view  is  displayed  at  one  time.  This  portion  is  adjusted  to  be  equal  to  the  angular  suh-tense  of 
tiic  di.splay  in  front  of  the  eye  in  order  to  make  the  scale  lactor  of'  the  displayed  image  equal  to  that  of  the  real  world.  This 
makes  tiic  panning  rate  of  the  imagery  in  the  display  equal  to  the  rate  of  head  motion,  which  minimizes  user  discomfort.  An 
electronic  zoom  capability  is  also  provided. 
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Figure  4.  Combined  sensors 


t 


SSO"*  Panoramic  Sensor  Unit 

360^x42*^  FOV  (26‘^xir  sub  FOV  displayed) 
Visible  CCD  {ICCD  or  LWIR  possible") 

Electronic  pan,  tilt,  zoom  - 

Multiple  simultaneous  users" 

Provides  low  latency  view  of  surroundings 
*  Future  ootiort 


Gimbaled  Infrared  Sensor  Unit 
field  of  view 

8-12  micron  infrBte^  sensor 
320x240  pixels  now 
$40x480  pixels  In  future 
Mechanically  scanned  gimbal 
Provides  high  resolution  detail 

I 


Figure  5*  Operation  and  display  of  the  combined  S'FTV  sensors 


23.  Helmet-Mounted  Display  with  Head  Tracker 

The  prototype  STTV  helmet-inounied  display  (Figure  6)  is  a  640x480  pixel  monochrome  AMEL  display  with  a  ileld  of  view  of 
26"(H)xl9''(V).  It  is  mounted  on  a  standard  Combat  Vehicle  Crew  (CVC)  helmet  in  a  way  that  allows  convenient  viewing 
while  minimizing  interference  when  moving  through  the  hatch  or  using  an  optical  sight.  The  display  mount  has  four  detent 
positions:  1 )  a  viewing  position  directly  in  front  of  the  eye,  2)  a  viewing  position  seven  degrees  below'  the  line  of  sight  that 
allows  looking  over  the  display,  3)  a  stow  position  beside  the  user's  chin,  and  4)  a  stow  position  behind  the  user's  right  ear.  The 
mount  allows  adjustment  of  the  display-to~eye  distance,  the  inter-pupiilary  distance,  and  the  horizontal  detent  position.  The 
display  has  brightness  and  contrast  controls  and  can  be  switched  to  display  either  vSTFV  video  or  FBCB2  situation  data.  The 
same  helntet  mount  can  accommodate  an  8()0x6()()  color  display  that  provides  improved  intelligibility  of  the  FBCB2  data. 

The  prototype  STTV  liead  tracker  is  a  commercially  available  IS3()0  head  tracker  made  by  IntcrSense  IncJ'^.  It  has  an  angular 
accuracy  of  C  to  3'"  RMS  and  an  update  rate  of  150  H/..  its  I. lx  1.2x1. 3  inch  inertial  measurement  unit  is  attached  atop  the 
CVC  helmet  and  provides  three  degrees  of  i'reedom  via  an  RS-232  data  link.  The  inertial  measurement  unit  uses  inexpensive 
angular  rate  gyros  that  provide  acceptable  performance  in  a  laboratory  environment.  However,  the  update  technique  used  to 
correct  for  gyro  drift,  based  on  sensing  the  earth's  gravitational  and  magnetic  fields  during  periods  of  head  motion  inactivity,  is 
not  intended  for  use  on  a  moving  armored  vehicle.  When  operation  on  a  moving  armored  vehicle  is  desired,  Honcyweirs 
metal-tolerant  magnetic  tracker  can  be  used.  This  tracker  has  been  tested  on  an  M  I  13  armored  personnel  carrier,  and  has  been 
confirmed  to  operate  with  the  accuracy  needed  by  the  S'lTTV  display  system. 


2.4.  Image  J^rocessor 


The  STFV  image  processor  (Figure  7)  is  a  PVT-20()  processor  developed  by  the  Sarnoff  Corporation  under  previous  DARPA 
contracts'^  It  is  sold  commercially  by  Pyramid  Vision  Technologies^^’,  it  consi.sts  of  an  8-sl<n  6ljx  160  subrack  in  a 
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14x19x11  inch  enclosure.  The  eight  slots  are  populated  with  a  processor  motherboard  (two  slots)  and  six  video  processor 
motherhoarcis.  The  processor  motherboard  contains  two  C40  digital  signal  processors  (DSP's)  and  two  daughter  boards,  with 
each  daughter  hoard  providing  another  C40  DSP,  All  four  DSP's  have  5  Mbytes  of  fast  static  RAM  each.  Each  video  processor 
motherboard  contains  four  2  Mbyte  and  one  16  Mbyte  simultaneous  read/write  frame  store  memories,  four  pyramid  processors, 
and  two  rcconfigurahlc  processing  elements,  plus  two  video  processor  daughter  boards.  Each  video  processor  daughter  board 
performs  a  spcciahpuqxKc  video  processing  function  such  as  warping,  correlation,  digitisation  of  analog  video,  or  displaying 
digital  outpui  in  an  analog  format.  The  arrangement  of  video  processor  daughter  hoards  is  recon figurabic,  and  in  the  case  of  the 
STFV  system  consists  of  three  digitizer  boards  for  nine  video  channels,  six  warper  boards  for  image  transformations,  one 
correlator  hoarti  for  three  channels  of  image  correiaiion,  and  two  display  boards.  Video  processing  is  accomplished  by 
pipelining  an  image  from  a  video  frame  store  or  DSP  memory,  routing  it  through  one  or  mote  reconfigurablc  processing 
clcmcnis.  daughter  boards,  or  DSP's,  and  writing  it  back  into  a  video  frame  store  or  DSP.  Multiple  video  frames  arc  prtx:e$$ed 
simuiiancouslv  using  high  bandwidth  programmable  interconnections  between  the  video  memories  and  processing  elements. 
F.ach  motherboard  has  a  crosspoint  switch  with  a  1.2  Gbytes/sec  bandwidth  that  routes  its  eight  video  input  busses  (33 
Mhytes/see  each)  to  its  various  onboard  processing  elements  and  then  routes  their  results  to  its  eight  video  output  busses.  The 
motherboards,  m  turn,  eommunicate  with  each  other  via  a  second  crosspoint  switch  of  1,8  Gbytes/scc  bandwidth  that  comprises 
the  global  haekphinc  bus.  This  architecture  allows  multiple  frames  of  video  to  be  processed  concurrently,  yielding  an 
euui\alcn!  prv >eessi>r  ihrougliput  of  50  Giga-operaiions  per  second.  The  processor  has  nine  RS-ITO  composite  analog  inputs, 
iv\i-  kS-  !"0  eou'.pi'sitc  analog  outputs,  and  four  RS-232  control  ports. 


:  ;.v'  !'\  d  2  '  pr.'.eNvor-  periorms  all  of  the  image  processing  and  control  functions  in  the  STTV  system.  It  digitizes  the  outputs 
i:u‘  e:gt::  pan.earir.e  sensor  eatneras,  selecting  the  one  or  two  video  data  streams  that  contain  the  commanders  current  field  of 
vieu .  ar.v:  v\arp::vj  the  images  to  correct  for  lens  distortion.  The  processor  then  warps  the  adjacent  images  again  in  real  time  to 
syath.cs:/.-  ivvv'  sub-images  in  the  correct  line  of  sight  direction,  stitching  them  together  and  blending  them  to  make  a 
ctMUiruiouv  image  uiiiioul  any  noticeable  joints  or  seams.  In  the  meantime,  it  slews  the  IR  sensor  to  the  same  line  of  sight 
positun:  and  digc:/es  the  IR  camera  output,  displaying  it  either  separately  or  fused  with  the  visible  sensor  data.  Electronic 
zoom  is  also  applied.  F'inaily.  a  moving  object  tracker  is  provided  that  enables  the  visible  and  IR  sensors  to  remain  locked  onto 
a  designated  targe:  uhile  the  vehicle  and  the  user's  head  undergo  arbitrary  motion.  Image  stabilization  can  also  be  provided 
elcctismicalU  \:a  liie  PVT-2()0.  The  algorithms  for  these  functions  were  adapted  from  algorithms  developed  by  the  Sarnoff 
Corporatik>n  under  previ(ms  DARPA  contracts*"^^'^^ 


2.5,  Commander's  Control  Panel 


Tile  STFV  sysicni  is  controlled  via  the  commander's  control  panel  shown  in  Figure  8.  The  commander  can  choose  to  display 
the  visible  panoramic  sensor  only,  the  gimbaled  IR  sensor  only,  or  both  sensors  together  in  a  fused  mode.  A  fourth  selection 
enables  the  display  of  a  sceond-generaiion  FLIR  sensor  with  appropriate  warping  of  the  imagery  to  show  it  on  a  display  having 
square  pixels.  The  IR  imagery  or  FLIR  imagery  can  be  viewed  as  either  white  hot  or  black  hot  to  allow  for  thermal 
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inversion  depending  on  the  time  of  day.  Viewing  is  done  in  response  to  the  user’s  head  orientation,  which  can  pan  through  a 
full  360"^  of  azimuth.  180^  of  azimuth,  and  360^  of  head  roll.  By  holding  down  the  HMD  VIEW  toggle  swftch,  the  user  can  see 
a  rear  view  I8(F  in  back  of  his  head  while  avoiding  the  need  to  turn  his  head  18<F.  When  viewing  imagery,  the  user  can  zoom 
either  in  or  out  or  can  make  the  size  of  the  target  reticle  larger  or  smaller.  These  fanciions  allow'  one  to  select  an  object  in  the 
current  field  of  view,  which  can  then  be  tracked  by  pressing  the  DESIGNATE  &  TRACK  TARGET  pushbmion.  While  the 
selected  object  is  being  tracked  in  a  special  tracking  window  by  the  visible  and  IR  sensors,  the  user  can  continue  to 
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Figure  8.  Commander’s  control  panel 

pan  the  visible  panoramic  sensor  in  an  arbitrary  direction  in  the  original  window.  As  the  target  object  slides  off  the  edge  of  the 
fielcl  of  view,  an  indicator  arrow  appears  to  show  the  user  in  which  direction  he  should  turn  his  head  to  re~acquire  the  tracked 
object.  The  user  can  view  the  target  in  the  tracking  window  at  any  time  by  depressing  the  VIEW  TARGET  pushbutton.  Thi.s 
function  simulates  the  slew-to-coe  function  found  on  the  M1A2  Abrams  and  the  M2A3  Bradley.  While  pressing  the  VIEW 
TARGET  pushbutton  the  user  can  re-ccnier  the  tracking  window  on  a  smaller  sub-object  in  the  tracked  object  and  then  select 
that  suh-ohjeci  by  using  the  DLSPLAY  ZOOM,  RETICLE  SIZE,  and  AIMPOINT  ADJUST  switches.  Pressing  the 
DESIGNATE  TRACK  TARGET  pushhuiion  a  second  time  then  causes  only  the  smaller  sub-object  to  be  tracked.  Releasing 
the  ViEW’^  TARGET  pushbutton  returns  the  display  to  the  original  window  in  the  direction  indicated  by  the  user’s  head  position, 
but  with  the  target  still  being  tracked  in  the  unseen  tracking  window.  When  the  user  wi.shes  to  exit  the  target  tracking  mode  he 
depresses  the  TRACK  HELMET  pushbutton,  which  returns  control  of  the  visible  and  IR  sen.sors  to  the  head  tracker  in  the 
current  head  position.  The  remaining  ALIGN  FWD  DIRECTION  switch  is  used  to  align  the  head  tracker  to  the  forward-facing 
sensor  direction,  defined  to  be  the  front  of  the  vehicle’s  turret.  The  user  depresses  this  pushbutton  while  pointing  his  head 
forward  in  the  turret  as  indicated  by  aligning  a  cros.shair  on  the  display  whth  a  mark  on  the  turret's  front  wall.  Alignment  only 
needs  to  be  peribrmed  once  on  system  power-up. 

2*6.  System  Block  Diagram 

A  bkxrk  diagram  of  the  contplete  STTV^  system  is  shown  in  Figure  9.  The  PVT-2(X)  processor  accepts  imagery  from  the  visible 
and  IR  sensors  and  generates  RS~I7()  outputs  for  the  vehicle  commander’s  heJmct-mounied  display  and  an  optional  squad 
leader's  hclmei-mounted  display.  1'he  commander  controls  both  the  visible  and  IR  sensors  via  the  commander’s  control  panel 
and  pans  through  the  selected  imagery  using  his  on-helmet  tracker,  In  a  future  option,  the  squad  leader  will  have  access  to  the 
imagery  from  the  visible  panoramic  sensor,  with  a  vehicle-mounted  joystick  for  panning.  The  squad  leader  will  then  be  able  to 
pan  and  view  the  visible  panoramic  sensor  in  any  direction  independently  of  the  vehicle  cammandcr  while  the  vehicle 
commander  is  using  the  same  sensor  for  other  purposes.  Both  the  vehicle  commander  and  the  squad  leader  will  have  access  to 
the  FBCE2  tactical  situation  data  on  their  helmet-mounted  displays. 


The  prototype  SITV  system  uses  a  laptop  computer  as  a  control  panel  for  dcvelopnicnt  purposes  to  facilitate  system  changes 
and  to  aid  in  software  development.  In  a  deployable  STTV  system  the  laptop  computer  will  not  be  used  and  the  commanders 
control  panel  will  communicate  directly  with  a  ruggedized  version  of  tlic  PVT-2CX)  processor 
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3.  DEPLOY ABI.E  STTV  SYvSTEM  FEATURES 

The  prototype  SITV  system  is  useful  for  demonstrating  system  operation,  but  does  not  address  all  the  system  requirements 
because  it  uses  only  existing  components  to  reduce  devcloptnent  cost.  A  deployable  STT'V  system  will  use  improved 
components  that  are  better  matched  to  the  system  rcqutrenicnts.  It  will  also  have  additional  image  processing  functions  and 
more  complete  integration  into  the  vehicle  systems.  Table  2  shows  some  of  the  improvements  envisioned  in  a  deployable 
STTV  system. 

One  major  improvement  is  upgrading  the  360^'  panoramic  sensor  from  visible  sensitivity  to  8-12  micron  sensitivity.  A 
prototype  sensor  of  this  type  having  a  640x480  pixel  focal  plane  has  already  been  dcveloped^^  Alternatively,  it  may  be  possible 
to  mosaic  several  640x480  pixel  mierobolometer  focal  planes  to  achieve  a  similar  result.  Sensor  resolution  can  be  improved  by 
the  use  of  larger  focal  planes  with  more  pixels^'  and  by  micro-scanning  techniques'^  A  suitable  IR -transparent  cylindrical 
window  will  also  be  supplied.  Protection  against  sntall  arms  lire  will  be  provided  in  the  form  of  a  retractable  armor  cylinder  that 
can  be  raised  or  lowered  around  the  sensor  or,  alternatively,  by  elevating  the  sen.sor  out  of  a  protective 'well. 


I'he  gimbaled  !R  sensor  will  be  improved  by  using  a  second  generation  FLIR  having  1316x480  pixels  and  dual  fteld  of  view 
optics.  This  sensor  is  already  available  on  some  armored  vehicles,  and  additional  vehicles  will  be  receiving  it  as  an  upgrade 
package.  If  an  8-12  micron  360'^  panoramic  sensor  is  provided  as  described  above,  a  second  generation  FLIR  may  not  he 
needed  if  the  range  of  the  panoramic  sensor  exceeds  the  range  of  the  vehicle’s  weaponry. 

The  helmet-mounted  display  will  be  improved  by  upgrading  to  an  800x6()0  pixel  color  Hal  panel  display  to  increase  resolution 
and  to  improve  color  contrast  for  FBCB2  map  information.  The  higher  resolution  flat  panel  display  will  also  have  a  wider  field 
of  view  that  will  add  more  content  to  the  sensor  imagery.  The  head  tracker  will  be  a  metal-tolerant  magnetic  tracker  with 
electronics  that  fit  onto  a  single  card.  The  single  card  construction  will  aid  significantly  in  reducing  tracker  cost.  A  prototype 
of  this  tracker  has  been  proven  effective  on  an  M 113  armored  vehicle"'  ,  and  transition  to  manufacturing  is  currently  in  progress. 

The  deployed  system  will  include  additional  image  processing  functions  such  as  higher  sensor  rCvSolution,  wider  display  Held  of 
view,  electronic  image  siablHxation,  provi.sion  for  a  second  independent  viewer  of  the  360'"  panoramic  camera  imagery,  and 
provision  for  di.sp laying  Unmanned  Aeronautical  Vehicle  (UAV)  reconnaissance  imagery. 
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Most  importantly,  the  deployed  system  will  be  integrated  into  the  vehicle  and  its  systems  much  more  effectively  chan  the 
prototype  system.  The  vSTTV  sensors  will  be  mounted  on  the  outside  of  the  vehicle  in  a  manner  that  protects  them  from  abuse 
and  in  a  location  that  increases  their  effectiveness  without  compromising  other  vehicle  sensors  or  functions.  The  STTV  controls 
will  be  mounted  inside  the  vehicle  in  a  location  that  is  accessible  to  the  commander  while  he  is  standing  in  the  hatch  or  with  the 
vehicle  buttoned  up.  The  controls  will  be  integrated  with  the  second  generation  FLIR  sensor  controls  and  the  vehicle  fire 
control  system  so  that  the  hunter-killer  teamwork  between  the  vehicle  commander  and  the  gunner  can  be  maintained.  The 
STTV  helmet-mounted  display  will  be  integrated  with  the  FBCB2  tactical  terminal  and  second  generation  FLIR  so  that  FBCB2 
information  and  second  generation  FLIR  imagery  can  be  displayed  effectively  and  still  be  controlled  properly  by  the  originating 
systems.  Finally,  the  STTV  system  will  be  integrated  with  new  systems  still  in  development  for  embedded  training  and 
embedded  maintenance  that  olTcr  the  possibility  of  reducing  vehicle  li  fe  cycle  cost. 

Table  2.  Improvements  envisioned  in  a  deployable  STTV  system 


Function 

Prototype  System 

Deployable  system 

360^"  panoramic  sensor 

Visible  sensitivity 

8  cameras 

5120  (H)  x48D  (V)  pixels 
acrylic  window 
unshielded 

8-12  micron  sensitivity 

1  camera 

SOOO(H)x500(V)  pixels 

IR-transparent  window 
retractable  armor  shield 

Gimbaied  IR  sensor 

1 316x480  2™  gen  FLIR  sensor 
dual  narrow  &  wide  FOV  optics 

HMD  display 

640x480  monochrome  HMD 
26"xir  FOV 

800x600  color  HMD 
wider  FOV 

Head  tracker 

commercial  inertial  tracker 

metal-tolerant  magnetic  tracker 

Image  processor 

8-slot  PVT-200  processor 

Next  generation  PVT  processor 

Image  processing  functions 

image  stitching 
electronic  zoom 
visible/]  R  fusion 
moving  target  tracking 

wider  display  FOV 
+  image  stabilization 
+  2^  viewer 
^  UAV  imagery 

-  visible/IR  fusion  (not  required) 

Vehicle  integration 

nondntegrated 

Sensor  integration  with  vehicle 

STTV  control  integration 

FBCB2  display  integration 

2"^^  gen  FLIR  integration 

Fire  control  system  integration 
Embedded  training 

Embedded  maintenance 

4.  STTV  SYSTEM  APPLICATIONS 


The  S'n^V  system  is  designed  primarily  for  turreted  armored  vehicles,  such  as  the  Ml  Abrams  and  the  M2  Bradley  (Figure  10), 
It  is  usually  these  vehicles  that  impose  the  heaviest  demands  on  the  vehicle  commanders  workload.  However,  non-turreied 
armored  vehicles,  such  as  the  Mil 3,  arc  also  potential  insertion  candidates.  New  armored  vehicles  currently  in  development, 
such  as  the  Crusader  the  Future  Scout  and  Cavalry  System  (FSCS),  the  Future  Combat  System  (FCS),  and  the  new'  family  of 
Medium  Armored  Vehicles  are  considered  to  be  especially  strong  candidates  for  the  STTV  system.  The  FCS  program  has 
formally  identified  the  need  for  a  panoramic  scnsor"^'^\  The  U.  S.  Army  TACOM  has  also  investigated  the  use  of  a  panoramic 
sensor  with  helmct-mounied  display  as  a  see-through  turret  system  for  this  purposc*^^'. 
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Piranha/LAV-105 


PanduT-IQS 


FSCS-Tracer 


FCS 


LAV-105  Auto-Loader 


Figure  10.  Vehicles  identified  forvSTFV  insertion 


5.  SUMMARY  AND  CONCLUSION 


This  paper  describes  the  design  of  a  combat  vehicle  visualization  system  that  provides  increased  situation  awareness  to  the 
vehicle  commander  while  seated  inside  the  vehicle  or  while  standing  in  an  open  hatch.  The  system  gives  the  vehicle  commander 
the  ability  to: 

1)  detect  terrain  hazards  in  the  vehicle's  path  to  aid  the  driver  in  recognizing  hazardous  situations  that  might 
immobilize  the  vehicle  or  cause  damage  to  the  vehicle  and  its  crcw\ 

2)  detect  nearby  friendly  forces  and  environmental  structures  lo  coordinate  movement  with  other  vehicles  and  to 
avoid  damage  to  the  vehicle,  nearby  friendly  forces,  or  man  made  structures, 

3)  detect  nearby  ground  threats  to  allow  protective  responses  to  be  employed, 

4)  view  imagery  from  the  commanders  independent  viewer  while  .standing  in  the  open  hatch, 

5)  view  information  on  the  commander's  tactical  display  while  standing  in  an  open  hatch  to  allow  immediate 
notification  of  incoming  reports  and  to  assist  in  the  preparation  of  outgoing  reports  wmhout  the  need  to  duck  back 
into  the  vehicle  , 

6)  view  UAV  reconnaissance  imagery  while  seated  inside  the  vehicle  or  while  standing  in  an  open  hatch. 

The  system  can  also  he  used  by  a  .squad  leader  in  the  vehicle's  passenger  compartment  as  a  rcconnoilering  aid  prior  to  exiting 
the  vehicle  for  dismounted  operations.  These  capabilities  are  especially  useful  at  night  when  the  enemy  is  in  the  vicinity  and 
when  direct  vision  is  impaired  because  vehicle  hatches  must  be  buttoned  up  and  vision  blocks  must  be  covered  to  avoid 
detection. 

llic  paper  describes  a  prototype  system  that  demonstrates  essential  system  features  using  existing  components  to  reduce 
development  cost.  Improvements  envisioned  for  a  deployable  system  are  discussed.  Finally,  vehicle  insertion  opportunities  are 
identified. 


120 

Presented  at  SPIE  s  "AeroSensc",  Orlando,  FL,  April  24-2S,  2(XK) 


to 


Bibliography 

1 ,  D.  Ratcliff,  “M 1 A2  tank  commander’s  independent  thermal  viewer  optics:  Systems  engineering  perspective’',  SPIE 
Froccedinos.  vol,  197(1  1993.  pJ  18* 

.  Jane's  hueniaiiona!  Defense  Review,  9/1 99E,  p,33*  See  also  wvvwxacd.rockwelLcom/hus_area/gps_air/, 

.  R.  Schvvatrn  and  J.  Bradley,  "Design  soluiions  for  thermal  imaging  devices  in  military  systems’*,  SP!E  Proceedings.  voL 
2736,  p.259. 

4.  "Kaiser  and  U.  S,  Army  tests  bead-steered  sensors  for  enhanced  night  driving’*,  Jane's  International  Defense  Review. 

7/!M98,  p.iS. 

5.  "Abrams  M 1  A2'\  The  website  for  defence  industries-army,  wvvw.army-lechnology.com/projects/ahrams/, 

6.  L.  ,M.  Haynesworth.  "BCIS  digital  data  link  as  part  of  the  digili?xd  battlefield”,  SPIE  Proceedings,  voL  2764,  p.  51-55. 

7.  "(\>:nha:  ID  nun-cs  on  as  funds  arc  granted”,  Jane's  Defence  Weekly,  December  18,  1996,  p,l9-2l , 

5.  Tom  \  Jolt  null.  May  1999,  p,54,  ^ 

( i  Saibodkin.  "Cl  A( ):  Pentagon  must  play  larger  role  in  force  XXI”,  Government  Campurer  News,  July  27, 

>>OS.p.S. 

( ^  ( ; .  s:,;bvKikir..  "Arniv  plans  S 1 5h  assault  -Five  year  plan  will  let  it  deploy  digital  battlefield  systems”, 

( /'  .  (  rf.au  r:f  (  (arpuier  \cws.  July  27,  1998,  p.l , 

:  J  \  !  C'\  '-MT/RS  catnera  specification.  Costar  Inc,  at  www.costar-usa.com 
2  sr  sera:  eotivertvr  specification,  Poynting  Products,  lnc„  Illinois,  at  www.poynting.com. 

'  1.2'  si  c.s'c  sp(  eifn  iition,  Nylcch  lnc,  CA,  at  ww\v,nytech-ir,com* 
r  spcciticjtioiL  IntcnSense  Inc.,  at  wwwJntersense.com, 

'  (1.  \ar.  dcr  WaL  and  M.  Hansen,  "Reconfigurable  elements  for  a  video  pipeline  processor,  IEEE  Symposium 

•  T’  ('us!<)mConipuring  (FCCM99),  April  99.  Development  of  the  PVT-2()0  processor  was  partially 

!)  \R1\A  .-ontracis  DAAK7(M)3-C-()()66  (MDARS-Exterior),  DAAI5-93-CMK)61  (Image  Stabilization),  and  ^ 

\  ^  -~-C  2^'!"'  ' (u\'xp:ilial  Rcgisiration). 

'■  ;  2  T’.  c\ \::r  Soci  iuciinon.  Pyramid  Vision  Technologies  Inc,  at  wwvv.pyramidvision.com. 

•  lu;'-.  M  P.  Anandcn,  "Video  mosaic  displays,”  SPIE  Proceedings,  vol.  2736,  1996,  p.l  19-127. 

^  *  i  s.;-,s  R  Kumar,  "'frue  multi-image  Alignment  and  its  application  to  mosaicing  and  lens  distortion  correction”, 

// ;  ->/.  f\:::cn:  Analysis  and  Machine  Intelligence,  vol.  2L  .No,3,  p.235-43,  March  1999. 

K  N!.  Hansen.  \\  Burt,  and  S.  Baten,  "Vision  for  autonomous  mobility  -  image  processing  on  the  VFE-20(r 

.  f  f  ILTI.  I ntcrnatiomi!  Symposium  on  Intelligent  Control  (ISIC).  International  Symposium  on 

i  reeic:::  /...  if.o  T:et  re  c  if:  Robotics  and  Automation  (CIRAf  and  intelligent  Systems  and  Semantics(ISAST 
MI).  fSA.  .September,  1998. 

s  K  Ku.^k.  J.  McMullen,  J.  Tcaguc,  "Staring  infrared  panoramic  scnsor  (SIRPS)  for  Surveillance  and  threat 

.ic.cc:. lo.^.  ccding^.  vol.  306 lV  585-590^ 

:  .2  R.  i>i:sv  "Siunr.g  :nlrared  panoramic  sensor”,  SPIE  vol  3436,  July  23,  1998. 

2.  i  .  liiv'm.ri’.c:,  Denms.  and  D.  Bradley,  "Effects  of  microscan  operation  on  vStaring  infrared  sensor  imagery”,  SPIE 

rrM/.'M-..  \\k.  l.>4().  1991,  p.  653-664. 

'1  ev:  resells  i'C-iaincd  under  the  STTV  program. 

4.  A.  Si'.;iri>m  ,ind  L.  Bacmi.  "The  hiiixrc  combat  system  (PCS)  —  A  technology  evaluation  review  and  feasibility  assessment" 
Aruira.  J u:\-Aiigusi  1907,  .Scptcmbcr-Octoher  1997,  November-December  1997. 

B.  Bender  and  .A.  Koch.  "U,S  Army  to  accelerate  future  combat  systems”,  Jane's  Defence  Weekly,  January  26,  2(X)C),  p.4. 

6.  "fJecirtmics  p,in,  till  and  zoom  system’'  in  ''Military  simulation:  out  of  the  lab  and  into  the  lield’4  Military  and  Aerospace 

Elcctronic.s.  November  1995.  p.  13,14, 


121 

Presen  led  at  SPIEs  "AcrOsSense”,  Orlando,  FL,  Apnl  24-2K,  2(XK) 


List  of  Symbols,  Abbreviations,  and  Acronyms 


AFATDS 

Advanced  Fire  and  Taciica!  Distribution  System 

AGS 

Armored  Gun  System 

AMEL 

Active  Matrix  Electro  Luminescent 

AMTT 

Advanced  Metal  Tolerant  Tracker 

APC 

Armored  Personnel  Carrier 

ATD 

Advanced  Technology  Demonstration 

AUSA 

Association  of  the  United  States  Army 

BAA 

Broad  Agency  Annoonccnieni 

BC 

Bradley  Commander 

BCIS 

Battlefield  Combat  identification  System 

BCV 

Bradley  Command  Vehicle 

BFIST 

Bradley  Fire  Support  Team 

BFISTV 

Bradley  Fire  Support  Team  Vehicle 

C2V 

Command  and  Control  Vehicle 

CCD 

Charge  Coupled  Device 

CDC 

Commander’s  Display  Unit 

CID 

Commander’s  Integrated  Display 

CIV 

Commander's  Independent  Viewer 

CITV 

Commander’s  independent  Thermal  Viewer 

CTD 

Commander’s  Tactical  Display 

eve 

Combat  Vehicle  Crew 

cws 

Commander’s  Weapon  Sight 

DARPA 

Defense  Advanced  Research  Projects  Agency 

DDC 

Day  Display  Component 

DID 

Driver's  Integrated  Display 

DSP 

Digital  Signal  Processor 

DVE 

Driver  Vision  Enhancer 

FBCB2 

FXXI  Battle  Command  Brigade  and  Below 

FCS 

Future  Combat  System 

FCV 

Future  Combat  Vehicle 

FISTV 

Fire  Support  Team  Vehicle 

Fl.IR 

Forward  Looking  Infra  Red  (Sensor) 

FOR 

Field  of  Regard 

FOV 

Field  of  View 

FSCS 

Future  Scout  and  Cavalry  System 

FXXI 

Force  21 

FXXIC- 

Force  2 1  Command  and  Control 

GCDP 

Gunner’s  Control  and  Display  Panel 

GDLS 

General  Dynamics  Land  Systems 

GITS 

GMHE  Integrated  TOW  Sight 

GPS 

Gunner’s  Primary  Sight 

GPS 

Global  Positioning  System 

HDTV 

High  Definition  Television 

HMD 

Helmet  Mounted  Display 

HMMWV 

High  Mobility  Mulu-Whecled  Vehicle 

HMWWV 

High  Mobility  Multi-Whecled  Vehicle  (common  mis- 

spelling) 

HTl 

Horizontal  Technology  integration 

H/ 

Hertz 

IB.AS 

Improved  Bradley  Accfuisition  System 

ICCD 

Intensified  Charge  Coupled  Device 

ices 

Integrated  Command  and  Control  System 

IDATT 

Integrated  Display  and  Tactical  Terminal  (color) 
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IHADDS 

IHAS 

IPD 

IR 

ITAS 

IVIS 

JCIT 

LAV 

LRIP 

MEMS 

NBC 

NETD 

NFOV 

NVESD 

CDS 

ONR 

PVSl 

RAM 

RvSTA 

SGF 

SEP 

SID 

SIMNET 

SIP 

SLID 

SPIE 

s'nrv 

SVGA 

TACOM 

'FARDEC 

TBD 

TOW 

TWS 

UAV 

UDLP 

VGA 

WFOV 

WRAP 


integrated  Helmet  And  Digital  Display  System 
Integrated  Helmet  Assembly  Subsystem 
Inter-Pupillary  Distance 
Infra-Red 

Improved  Target  Acquisition  System  (SGF) 

Inter  Vehicular  Information  System 
Joint  Command  Information  Terminal 
Light  Armored  Vehicle 
Low  Rate  Initial  Production 
Micro  Electro  Mechanical  System 
Nuclear  Biological  Chemical 
Noise  Equivalent  Temperature  Difference 
Narrow  Field  of  V iew 

Night  Vision  and  Electronic  Sensors  Directorate 

Operation  Desert  Storm 

Office  of  Naval  Research 

Panoramic  Vision  Systems  Incorporated 

Random  Access  Memory 

Reconnaissance,  Surv^eil lance,  and  Target  Acquisition 

Second  Generation  FLJR 

System  Enhancement  Program 

Society  for  Information  Display 

Simulation  Network  (DARFA) 

System  Improvement  Program 

Small  Low-Cost  Interceptor  Device 

Society  of  Photo-Optical  and  Instrumeniattcn  Engineers 

See-Through  Turret  Visualization 

Super  Video  Graphics  Adapter  {8(X)x6(X)  pixels) 

Tank  Automotive  and  Armaments  Command 

Tank  Automotive  Research  Development  and  Engineering  Center 

To  Be  Determined 

Terminally  Optical  Wire-Guided 

Thermal  Weapon  Sight 

Unmanned  Aerial  Vehicle 

United  Defense  Limited  Partnership 

Video  Graphics  Adapter  (640x480  pixels) 

Wide  Field  of  View 

Warfighter  Rapid  Acquisition  Program 
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